73 W'ATENT COOPERATION TREA: 

From the INTERNATIONAL SEARCHING AUTHORITY 



To: 

Murgiana Haq 
Farah Namazie 

HAQ & NAMAZIE PARTNERSHIP 
Robinson Road Post Office, 
P.O.Box 765, 
Singapore 901515 
REPUBLIC OF SINGAPORE 




NOTIFICATION OF TRANSMITTAJ 
THE INTERNATIONAL SEARGr^REPQrlT 
OR THE DECLAI 

(PCT Rule 44.1) 



Applicant's or agent's file reference 
SY5000149WOF 



Date of mailing 

(day/monthfyear) 21 Mai. 1999(21.05.99) 



FOR FURTHER ACTION See paragraphs 1 and 4 below 



International application No. 
PCT/ SG 98/00039 



International filing date 

(day/month/year) 1 Jun. 1998 (01.06.98) 



Applicant 

HO, ANTHONY TONG SHUEN et al. 



1. [3 applicant is hereby notified that the international search report has been established and is transmitted herewith- 

Filing of amendments and statement under Article 19: 

The applicant is entitled, if he so wishes, to amend the claims of the international application (see Rule 46): 

When? The time limit for filing such amendments is normally two months from the date of transmittal of the 
international search report; however, for more details, see the notes on the accompanying sheet. 

Where? Directly to the International Bureau of WIPO * 
34, chemin des Colombettes 
1211 Geneva 20, Switzerland 
Facsimile No.: (41-22)740.14.35 

For more detailed instructions, see the notes on the accompanying sheet 

2. r~J The applicant is hereby notified that no international search report will be established and that the declaration under Article 
' l/(2)(a) to that effect is transmitted herewith. 



With regard to the protest against payment of (an) additional fee(s) under Rule 40.2, the applicant is notified that: 

I I the protest together with the decision thereon has been transmitted to the International Bureau together with 
I — I applicant's request to forward the texts of both the protest and the decision thereon to the designated Offices. 

I I no decision has been made yet on the protest; the applicant will be notified as soon as a decision is made. 



Further action(s): The applicant is reminded of the following: 

Shortly after 18 months from the priority date, the international application will be published by the International Bureau. If the 
applicant wishes to avoid or postpone publication, a notice of withdrawal of the international application, or of the priority 
claim, must reach the International Bureau as provided in Rules 906*. I and 90bis.3, respectively, before the completion of 
the technical preparations for international publication. 

Within 19 months from the priority date, a demand for international preliminary examination must be filed if the applicant 
wishes to postpone the entry into the national phase until 30 months from the priority date (in some Offices even later). 

Within 20 months from the priority date, the applicant must perform the prescribed acts for entry into the national phase before 
all designated Offices which have not been elected in the demand or in a later election within 1 9 months from the priority date 
or could not be elected because they are not bound by Chapter II. 



Name and mailing address of the ISA/ AT 

AUSTRIAN PATENT OFFICE 
Kohlmarkt8-10 
A-1 01 4 Vienna 

Facsimile No. +43 / 1 / 534 24 - 535 



Authorized officer 



Telephone No. 



Wolf 

+43/1 7534 24 - 436 



Form PCT/IS A/220 (July 1998) 



(See notes on accompanying sheet) 



PATENT COOPERATION TREATY 

PCT 

INTERNATIONAL SEARCH REPORT 

(PCT Article 1 8 and Rules 43 and 44) 



©9/701808 



Applicant's or agent's file reference 

SY5000149WOF 



FOR FURTHER 
ACTION 



see Notification of Transmittal of International Search Report 
(Form PCT/1S A/220) as well as, where applicable, item 5 below. 



International application No. 

PCT/SG 98/00039 



International filing date {day/month/year) 

01 June 1998 (01.06.98) 



Applicant 



(Earliest) Priority Date {day/month/year) 

05 January 1998 (05.01.98) 



HO, ANTHONY TONG SHUEN et al. 



^ZTS^J^tr^ h3S K been d 5" Intemational Searchi °S A «*ority is transmitted to the applicant 
according to Article 1 8. A copy is being transmitted to the International Bureau. 

This international search report consists of a total of 3 sheets. 

□ It is also accompanied by a copy of each prior art document cited in this report. 



1. Basis of the report " ' 

a. With regard to the language the international search was carried out on the basis of the international application in the 
language in which it was filed, unless otherwise indicated under this item. 

□ the international search was carried out on the basis of a translation of the intemational application furnished to this 
Authority (Rule 23. 1 (b)). 

b * ^!^ h regard t0 n " c,€0 « dc u an ^5 f acid sequence disclosed in the intemational application, the intemational 
search was earned out on the basis of the sequence listing- 

□ contained in the intemational application in written form 

□ filed together with the intemational application in computer readable form 

□ furnished subsequently to this Authority in written form 

□ furnished subsequently to this Authority in computer readable form. 

□ the statement that the subsequently furnished written sequence listing does not go beyond the disclosure in the 
international application as filed has been furnished. 

□ the statement that the information recorded in computer readable form is identical to the written sequence listing has 
been furnished. & 

□ Certain claims were found unsearchable (See Box I) 
Unity of invention is lacking (See Box II). 

4. With regard to the title, 

[3 the text is approved as submitted by the applicant 

□ the text has been established by this Authority to read as follows: 

With regard to the abstract, 

^ the text is approved as submitted by the applicant. 

□ the text has been established, according to Rule 38.2(b), by this Authority as it appears in Box IE. The applicant may 
within one month from the date of mailing of this intemational search report, submit comments to this Authority. 

The figure of the drawings to be published with the abstract is Figure No ■ ? 

□ as suggested by the applicant. None of the figures. 
^ because the applicant failed to suggest a figure. 

□ because this figure better characterizes the invention. 



Form PCT/ISA/210 (first sheet) (July 1998) 



INTERNATI 



SEARCH REPORT 



Inwnational application No. 

PCT/SG 98/00039 



A. CLASSIFICATION OF SUBJECT MATTER 
IPC 6 : G 06 F 12/14 

According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 

IPC 6 : G 06 F 12/14 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 

EPODOC, WPI, PAJ 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



EP 0 840 513 A (NIPPON ELECTRIC) 06 Msy 1998 (06.05.98), 
abstract. 

EP 0 855 681 A (NIPPON TELEGRAPH & TELEPHONE) 29 July 
1998 (29.07.98), abstract. 

EP 0 766 468 A (NIPPON ELECTRIC) 02 April 1997 (02.04.97), 
abstract. 



Relevant to claim No. 



□ 

Further documents are listed in the continuation of Box C. 



See patent family annex. 



Special categories of cited documents: 
A" document defining the general state of the art which is not 

considered to be of particular relevance 
,E" earlier application or patent but published on or after the international 
filing date 

L" document which may throw doubts on priority claim(s) or which is 
cited to establish the publication date of another citation or other 
special reason (as specified) 
O" document referring to an oral disclosure, use, exhibition or other 
means 

P" document published prior to the international filing date but later than 
the priority date claimed 



„T" later document published after the international filing date or priority 

date and not in conflict with the application but cited to understand 

the principle or theory underlying the invention 
(t X" document of particular relevance; the claimed invention cannot be 

considered novel or cannot be considered to involve an inventive step 

when the document is taken alone 
„Y M document of particular relevance; the claimed invention cannot be 

considered to involve an inventive step when the document is 

combined with one or more other such documents, such combination 

being obvious to a person skilled in the art 
„&" document member of the same patent family 



Date of the actual completion of the international search 

11 May 1999(11.05.99) 



Date of mailing of the international search report 

21 May 1999 (21.05.99) 



Name and mailing adress of the ISA/AT 

Austrian Patent Office 
Kohlmarkt 8-10; A-1014 Vienna 

Facsimile No. 1/53424/535 



Authorized officer 

Fastenbauer 
Telephone No. 1/53424/447 



Form PCT/ISA/210 (second sheet) (July 1998) 
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INTERNAL 
Informatio 



JAlal search report 

patent family members 



brnationai application No. 
PCT/SG 98/00039 



Im Recherchenber ich t 
anqemrtes Patentdokiwent 

Patent document cited 
^ in search report 
Document de brevet cit6 
da ns le rap port de recherche 

EP 840513" 



tt Datua der 
VerMfentlichunq 
Publication * 
~ date 
Date de 
publication 



Mitoliedter) der 
Palentfamille 
Patent favily 
neater (s J 
He«bre(s) de la 
faaille de brevets 



Datuii der 
Vteroffentlichun^ 
Publication * 

- date* 

Date de 
publication 



AU Al 

CA AA 

EP A2 

JP A2 



44340/97 
2219205 
B4C513 
10145757 



07-05- 

05- 05- 

06- 05- 
29-05- 



1998 
1998 
1998 
1998 



EP 



935631 



EP A2 

JP A2 

JP A2 

JP A2 

JP A2 

JP A2 



8556£ 
1021041. 
10257300 
1 0304323 
11018064 
1 1041573 



29-07- 
07-08- 
25-09- 
13-11- 
22-01- 
12-02- 



1998 
1998 
1998 
1998 
1999 
1999 



EP 



766468 



AU Al 
AU B2 
CA AA 
EP A2 
JP A2 



65840/96 
701639 
2184949 
766468 
9191394 



10-04-1997 
O4-02-1999 
29-03-1997 
02-04-1997 
22-07-1997 



PCT/SG98/00039 



P#ENT COOPERATION TRE^ / 7 0 1 8g<gpy 



From the INTERNATIONAL BUREAU 



PCT 

NOTIFICATION OF THE RECORDING 
OF A CHANGE 

(PCT Rule 92bis.1 and 
Administrative Instructions, Section 422) 


To: 

HAQ, Murgiana \5s5IZ K > 
Haq & Namazie Partnership jg$r* " 
Robinson Road V * ^\ ^Y?^ 
P.O. Box 765 " RECEIVED \5 
Singapore 901515 — f i 7 um iqqq pd 
SINGAPOUR > JL! , ! B 


Date of mailing (day/month/year) 

04 November 1999 (04.11.99) 


Applicant's or agent* s file reference 
SY5000149WOF 


IMPORTANT NOTIFICyvfrcW^^ 


International application No. 
PCT/SG98/00039 


International filing date (day/month/year) 

01 June 1998 (01.06.98) 



1. The following indications appeared on record concerning: 

X the applicant | [ ; the inventor | | the agent | | the common representative 


Name and Address 

DATAMARK TECHNOLOGIES PTE LTD. 
Suite 106 

Innovation Centre, Block 1 
16 Nanyang Dive 
Singapore 637722 
Singapore 


State of Nationality 
SG 


State of Residence 
SG . 


Telephone No. 


Facsimile No. 


Teleprinter No. 


2. The International Bureau hereby notifies the applicant that the following change has been recorded concerning: 
[ | the person | | the name | [ the address the nationality / the residence 


Name and Address 

DATAMARK TECHNOLOGIES PTE LTD. 
Suite 106 

Innovation Centre, Block 1 
16 Nanyang Dive 
Singapore 637722 
Singapore 


State of Nationality 
SG 


State of Residence 
SG 


Telephone No. 


Facsimile No. 


Teleprinter No. 


3. Further observations, if necessary: m 

Please be advised that Data mark Technologies Pte Ltd. si the applicant for all designated 
states except the US and messieurs HO and Tarn are applicant/inventors for the US only. 


4. A copy of this notification has been sent to: 
| X j the receiving Office | | the designated Offices concerned 
| | the International Searching Authority the elected Offices concerned 
| | the International Preliminary Examining Authority | | other: 


The International Bureau of WIPO 
34, chemin des Cotombettes 
1211 Geneva 20, Switzerland 

Facsimile No.: (41-22) 740.14.35 


Authorized officer / / 

P. Regis j 1/ 

Telephone No.: (41-22) 338.83.38 v 



PCT/SG98/00039 



PATENT COOPERATION TREA1 

From the INTERNATIONAL BUREAU 



PCT 

NOTIFICATION OF THE RECORDING 
OF A CHANGE 

(PCT Rule 92bis.1 and 
Administrative Instructions, Section 422) 



Date of mailing (day/month/year) 
22 October 1998 (22.10.98) 



Applicants or agents file reference 
SY5000149WOF 



To: 



HAQ, Murgiana 

Haq 8t Namazie Partnership 

Robinson Road 

P.O. Box 765 

Singapore 901515 

SINGAPOUR 



IMPORTANT NOTIFICATION 



International application No. 
PCT/SG98/00039 



International filing date (day/month/year) 
01 June 1998(01.06.98) 



Name and Address 

HO, Anthony, Tong, Shuen 


State of Nationality 1 State of Residence 
GB 1 SG 


Telephone No. 


Facsimile No. 


Teleprinter No. 



1. The following indications appeared on record concerning: 

the inventor 

I 



the applicant 



| | the common representative 



2. The International Burea u her eby notifies 
| | the person | X| the name 



^llbaiilindvuiw iwhw^t — w - 

| | the address Q the nationality [_J the residence 



Name and Address 

HO, Anthony, Tung, Shuen 



State of Nationality 
GB 



State of Residence 
SG 



Telephone No. 



Facsimile No. 



Teleprinter No. 



3. Further observations, if necessary: 



4. A copy of this notification has been sent to: 

| X| the receiving Office 

|~X| the International Searching Authority 

| | the International Preliminary Examining Authority 



| | the designated Offices concerned 
| | the elected Offices concerned 
| | other: 



The International Bureau of WIPO 
34, chemin des Colombettes 
121 1 Geneva 20, Switzerland 



Facsimile No.: (41-22) 740.14.35 
Form PCT/1B/306 (March 1994) 



Authorized officer 

N. Fischer 

Telephone No.: (41-22) 338.83.38 




L 



( 



• 


• 


PCX 

REQUEST 

The undersigned requests that the present 
international application be processed 
according to the Patent Cooperation Treaty. 


For receiving Office use only 
International Application No. 


International filing Date 


Name of receiving Office and "PCT International Application" 


Applicant's or agent's file reference 

(if desired) (12 characters maximum) OIJ UUU 1 4y W Or 


Box No. I TITLE OF INVENTION 

METHODS FOR EMBEDDING IMAGE, AUDIO AND VIDEO WATERMARKS IN DIGITAL DATA 


Box No. H APPLICANT 


Name and address: (Family name followed by given name; for a legal entity, full official designation. The address 
must include postal code and name of country. The country of the address indicated in this Box is the applicant s State 
(he. country) of residence if no State of residence is indicated below.) 

HO, ANTHONY TONG SHUEN 
c/o Nanyang Technological University 
School of Electrical & Electronic Engineering 
Block S2, Nanyang Avenue 
Singapore 639798 
Republic of Singapore 


|X % | This person is also inventor. 
Telephone No. 

Facsimile No. 

Teleprinter No. 


State (Xff. country) of nationality: 
GB, CA 


State (Le. country) of residence: 
SG 


This person is applicant r~ — | all designated I 1 all designated States except 1 1 the United States | 1 the States indicated in 

fo? the purposes of: liS_J States 1 1 the United States of America 1 1 of America only 1 1 the Supplemental Box 


Box No. m FURTHER APPLICANT(S) AND/OR (FURTHER) INVENTOR(S) 


Name and address: (Family name followed by given name; for a legal entity, full official designation. The address 
must include postal code and name of country. The country of the address indicated in this Box is the applicant s State 
(i.e. country) of residence if no State of residence is indicated below.) 

TAM SIU CHUNG 

c/o Nanyang Technological University 
School of Electrical & Electronic Engineering 
Block S2, Nanyang Avenue 
Singapore 639798 
Republic of Singapore 


This person is: 
| j applicant only 
|^ j applicant and inventor 
1 1 inventor only (if this check-box 

1 1 is marked, do not Jill in below.) 


State (i.e. country) of nationality: 
SG 


State Cue. country) of residence: 
SG 


This person is applicant y all designated 1 1 all designated States except j 1 the United States 1 j the States indicated in 

for the purposes of: ^ States . 1 1 the United States of America 1 1 of America only 1 1 the Supplemental Box 


[ | Further applicants and/or (further) inventors are indicated on a continuation sheet. 


Box No. IV AGENT OR COMMON REPRESENTATIVE; OR ADDRESS FOR CORRESPONDENCE 


The person identified below is hereby/has been appointed to act on behalf of the Iv 1 Agent 1 1 common representative 
applicant(s) before the competent International Authorities as: 1 1 


Name and address: (Family name followed by given name; for a legal entity, fall official designation. The 
address must include postal code and name of country.) 

Murgiana Haq 
Farah Namazie 

of HAQ & NAMAZIE PARTNERSHIP 
Robinson Road, P.O. Box 765, 
Singapore 901515 


Telephone No. 
(65) 438 6613 

Facsimile No. 

(65) 438 7383 , (65) 438 7393 
Teleprinter No. 


1 1 Mark this check-box where no agent or common representative is/has been appointed and the space above is used 
' ' instead to indicate a special address to which correspondences should be sent. 



FormPCT/RO/101 (first sheet) (January 1997; reprint July 1997) See Notes to the request form 



Sheet No 



DKSICNA HON OF STATES 



The following designations are hereby made under Rule 4.9(a) (murk the <ippttcabte check boxes; at least one must be marked): 
Regional Patent 

□ AP ARIPO Patent: GH Ghana. GM Gambia. KE Kenya. LS Lesotho. MW Malawi, SD Sudan. SZ Swaziland. UC Uganda. 

ZW Zimbabwe, and any other State which is a Contracting State of the Harare Protocol and of the PCT 

□ FA Eurasian Patent: AM Armenia. AZ Azerbaijan. BY Belarus. KG Kyrgyzstan. KZ Kazakhstan. MD Republic of 

Moldova. RU Russian Federation. TJ Tajikistan. TM Turkmenistan, and any other State which is a Contracting State 
of the Eurasian Patent Convention and of the PCT 
H EP European Patent: AT Austria. BE Belgium. CH and LI Switzerland and Liechtenstein, DE Germany. DK Denmark. 

ES Spain. FI Finland, FR France. GB United Kingdom. GR Greece. IE Ireland. IT Italy. LU Luxembourg. MC Monaco, 
NL Netherlands, PT Portugal. SE Sweden, and any other State which is a Contracting State of the European Patent 
Convention and of the PCT 

n OA O API Patent: BF Burkina Faso. B J Benin, CF Central African Republic. CG Congo, CI Cdte d' Ivoire, CM Cameroon, 
GA Gabon. GN Guinea, ML Mali, MR Mauritania, NE Niger. SN Senegal. TD Chad. TG Togo, and any other State 
which is a member State of OAPl and a Contracting State of the PCT {If other kind of protection or treatment desired, specify 

on dotted line) 

National Patent (if other kind of protection or treatment desired, specify on dotted line): 



□ 
□ 
□ 

ob 

□ 
□ 
□ 
□ 
□ 
□ 

53 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 

□ 
□ 
□ 

□ 
□ 
□ 
□ 
□ 
□ 



Albania 

Armenia 

Austria 

Australia 

Azerbaijan 

Bosnia and Herzegovina 

Barbados 

Bulgaria 

Brazil • - 

Belarus 
Canada 

CH and LI Switzerland and Liechtenstein 

CN China ■ 

Cuba 

Czeeji Republic 

Germany 

Denmark < 

Estonia 

Spain 

Finland 

United Kingdom 

Georgia 

Ghana 

GM Gambia 

GW Guinea-Bissau 

HU Hungary 

Indonesia 

Israel 

Iceland 

Japan 

Kenya 

Kyrgyzstan 

Democratic People's Republic of Korea 



AL 
AM 
AT 
AU 
AZ 
BA 
BB 
BG 
BR 
BY 
CA 



CU 

CZ 

DE 

DK 

EE 

ES 

FI 

GB 

GE 

GH 



ED 

IL 

IS 

JP 

KE 

KG 

KP 



□ 
□ 
□ 
□ 
□ 
□ 

□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 

□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 
□ 

□ 
□ 
□ 
□ 



LT Lithuania 
LU Luxembourg 
LV Latvia 

MD Republic of Moldova 

MG Madagascar 

MK The former Yugoslav Republic of Macedonia 

MN Mongolia 

MW Malawi 

MX Mexico 

NO Norway 

NZ New Zealand 

PL Poland 

PT Portugal 

RO Romania 

RU Russian Federation 

SD Sudan 
SE Sweden 
SG Singapore 

SI Slovenia 

SK Slovakia • 

SL Sierra Leone 

TJ Tajikistan 

TM Turkmenistan 

TR 
TT 
UA 
UG 
US 

UZ 
VN 
YU 
ZW 



Turkey 

Trinidad and Tobago . . . 

Ukraine 

Uganda 

United States of America . 



Uzbekistan 
Viet Nam . 
Yugoslavia 
Zimbabwe . 



KR 
KZ 
LC 
LK 
LR 
LS 



Republic of Korea Check-boxes reserved for designating States (for the purposes of 

tri-r^v-hemn a national patent} which have become party to the PCT after 

issuance of this sheet: 



Kazakhstan 
Saint Lucia 
Sri Lanka 
Liberia 
Lesotho 



□ 
□ 
□ 



In addition to the designations made above, the applicant also makes under Rule 4.9(b) all designations which would be permit ted 

under the PCT except the designation(s) of __ — — : ; .. . . „. ~ n „r.rmr.U 

The applicant declares that those additional designations are subject to ^confirmation and that any d" 1 * 0 * 

before the expiration of 15 months from the priority date is to be regarded as withdrawn by the applicant at the exp ration or tbtttime 
limit. (Confirmation of a designation consists of the filing of a notice specifying that designation and the payment of the designation and confirmation 
fees. Confirmation must reach the receiving Office within the 1 3 -month time limit.) 



Form PCT/RO/IOI (second sheet) (January 1998) 
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Sheet No. 3 



Box No. VI PRIORITY CLAIM 



Further priority claims are indicated in the Supplemental Box □ 



The priority of the following earlier application(s) is hereby claimed: 



Country 
(in which, or for which, the 
application was filed) 



Item (I) 



Filing Date 
(day/month/year) 



Application No. 



Office of filing 
(only for regional or international 
application) 



Item (2) 



Item (3) 



Mark the following check-box if the certified copy of the earlier application is to be issued by the Office which for the purposes of the present international 
application is the receiving Office (a fee may be required): 

□ The receiving Office is hereby requested to prepare and transmit to the International Bureau a certified copy o?the earlier 
application(s) identified above as item(s) : ' 



Box No. VTT INTERNATIONAL SEARCHING AUTHORITY 



Choice of International Searching Authority (ISA) Of two or more International Searching authorities are competent to carry out the international 

search, indicate the Authority chosen; the two-letter code may be used): ISA / AT 

Earlier search Fill in where a search (international, international-type or other) by the International Searching Authority has already been carried out 
or requested and the Authority is now requested to base the international search, to the extent possible, on the results of that earlier search. Identify such 
search or request either by reference to the relevant application (or the translation thereof) or by reference to the search request: 

Country (or regional Office): Date (day/month/year): Number: 



Box No. Vm CHECK LIST 



This international application contains the following 
number of sheets: 

3 sheets 

1 5 sheets 

8 sheets 

1 sheets 

10 sheets 



1 . request 

2. description 

3. claims 

4. abstract 

5. drawings 

Total 



37 sheets 



This international application is accompanied by the ttem(s) marked below: 



IX I separate signed 5. | X| 

1 — power of attorney 

fx"| copy of general 6. | | 

power of attorney 

| | statement explaining 7. | | 

lack of signature 

| | priority documents) 8. | | 
identified in Box No. VI 

as item(s): 



fee calculation sheet 

separate indications concerning 
deposited microorganisms 

nucleotide and/or amino acid 
sequence listing (diskette) 

other (specify): 



Figure No. 



. of the drawings (if any) should accompany the abstract when it is published. 



Box No. IX SIGNATURE OF APPLICANT OR AGENT 

Next to each signature, indicate the name of the person signing and the capacity in which the person signs (if such capacity is not obvious from reading the request). 



Farah Namazie 
Agent 



1 . Date of actual receipt of the purported 
international application: 


2. Drawings: 
[ | received: 
[ | not received: 


3. Corrected date of actual receipt due to later but 
timely received papers or drawings completing 
the purpose international application: 


4. Date of timely receipt of the required 
Corrections under PCT Article 1 1(2): 


5. International Searching Authority 

Specified by the applicant: ISA / 


6. 1 1 Transmittal of search copy delayed 

1 I until search fee is paid 


Date of receipt of the record copy 
| By the International Bureau: 



Form PCT/RO/101 (last sheet) (January 1997; reprint July 1997) 



See Notes to the request form 



Tliis sth^&is not part of and ttoes not count as a sheet of the internthmnal application. 

— p or receiving Office use only 



PCT 



FEE CALCULATION SHEET 
Annex to the Request 



Applicant's or agent's 

file reference SY5000I49WOF 



International application No. 



Date stamp of the receiving Office 



Applicant Hq, Anthony Tung Shuen 

Tam Siu Chung 



CALCULATION OF PRESCRIBED FEES 

I. TRANSMITTAL FEE 



135 



2. SEARCH FEE 

International search to be carried out by. 



287 



AT 



(If two or more International Searching Authorities are competent in relation to the international 
application, indicate the name of the Authority which is chosen to carry out the international search.) 



3. INTERNATIONAL FEE 
Basic Fee 

The international application contains^ 
first 30 sheets 



37 



sheets. 



690 



16 



remaining sheets additional amount 

Add amounts entered at bt and b 2 and enter total at B 



112 



802 



Designation Fees 

The international application contains, 
6 x 



designations. 



160 



960 



amount of designation fee 



number of designation fees 
payable (maximum II) 

Add amounts entered at B and D and enter total at I 

(Applicants from certain States are entitled to a reduction of 75% 
of the international fee. Where the applicant is (or all applicants 
are) so entitled, the total to be entered at I is 25% of the sum of 
the amounts entered at B and D.) 



1762 



4. FEE FOR PRIORITY DOCUMENT . 



5. TOTAL FEES PAYABLE 

Add amounts entered at T, S, I and P, and enter total in the TOTAL box.. 



2184 



TOTAL 



□ The designation fees are not paid at this time. 



Mode of Payment 
| | authorization to charge 

deposit account (see below) 

cheque 

□ 

postal money order 



I | bank draft 
I I cash 

| • I revenue stamps 



| | coupons 

| | other (specify): 



b 2 



J3 



Deposit Account Authorization (this mode of payment may not be available at all receiving Offices) 

The RO/ Q is hereby authorized to charge the total fees indicated above to my deposit account. 

□ is hereby authorized to charge any deficiency or credit any overpayment in the total 
fees indicated above to my deposit account. 

□ is hereby authorized to charge the fee for preparation and transmittal of the priority document 
to the International Bureau of WIPO to my deposit account 



Deposit Account Number Date (day/month/year) 

Form PCT/RO/101 (Annex) (January 1996; reprint July 1997) 



Signature 

See Notes to the fee calculation sheet 



The demand 
competent, 
the line below : 
IPEA / AU 



nd must be filed directly ^^^ne competent International Preliminary Examininc/^^kority or, if two or more Authorities are 
\ with the one chosen byWrappticant The full name or two-letter code of that MKrity may be h 



indicated by the applicant on 



PCT 

DEMAND 



CHAPTER II 



under Article 31 of the Patent Cooperation Treaty: 
The undersigned requests that the international application specified below be the subject of 
International preliminary examination according to the Patent Corporation Treaty and 
hereby elects all eligible States (except where otherwsie indicated). 



Identification of IPEA 



For International Preliminary Examining Authority use only 



Date of receipt of DEMAND 



BOX No. 1 IDENTIFICATION OF THE INTERNATIONAL APPLICATION 



Applicant's or agent* s file reference 
SY5000149WOF 



International application No. 
PCT/SG98/00039 



International filing date (day/month/year) 
01 June 1998 (01-06.98) 



(Earliest) Priority date (day/month/year) 



Title of invention 

METHODS FOR EMBEDDING IMAGE, AUDIO AND VIDEO WATERMARKS IN DIGITAL DATA 



Box No. II APPLICANT(S) 



Name and address: (Family name followed by given name; for a legal entity, full official 

designation. The address must include postal code and name of country) 

DATAMARK TECHNOLOGIES PTE LTD 

SUITE 106, INNOVATION CENTRE, BLOCK 1 
16 NAN YANG DRIVE 
SINGAPORE 637722 
REPUBLIC OF SINGAPORE 



Telephone No.; 



Facsimile No.: 



Teleprinter No.: 



State (i.e. country) of nationality; 
SG 



State (i.e. country) of residence: 
SG 



Name and address: (Family name followed by given name; for a legal entity, full official designation. The address must include postal code and 
name of country.) 

HO . ANTHONY TUNG SHUEN 

C/O NANYANG TECHNOLOGICAL UNIVERSITY, 

SCHOOL OF ELECTRICAL & ELECTRONIC ENGINEERING 
BLOCK S2, NANYANG AVENUE, SINGAPORE 639798 
REPUBLIC OF SINGAPORE 



State (i.e. country) of nationality: 
CA 



State (i.e. country) of residence: 
SG 



Name and address: (Family name followed by given name; for a legal entity, full official designation. The address must include postal code and 
name of country.) 

TAMSIU CHUNG 

C/O NANYANG TECHNOLOGICAL UNIVERSITY, 

SCHOOL OF ELECTRICAL & ELECTRONIC ENGINEERING 
BLOCK S2, NANYANG AVENUE, SINGAPORE 639798 
REPUBLIC OF SINGAPORE 



State (i.e. country) of nationality: 
SG 



State (i.e. country) of residence: 
SG 



I I Further applicants are indicated on a continuation sheet. 



Form PCT71PEA/401 (first sheet) (July 1998) 



See Notes to the demand form 



iternational application No. 
Sheet No. 2. I PCT/SG98/00039 



Vmti 

Jpc 



Box No. Ill AGENT OF COMMON REPRESENTATIVE; OR ADDRESS FOR CORRESPONDENCE 



The following person is [x] agent Q common representative 

and [x] has been appointed earlier and represents the applicant(s) also for international preliminary examination. 

| | is been appointed and any earlier appointment of (an) agent(s) / common representative is hereby revoked. 

| I is hereby appointed, specifically for the procedure before the International Preliminary Examining Authority, in addition to 
1 — 1 the agent(s) / common representative appointed earlier. 



Name and address: (Family name followed by given name; for a legal entity, full official 

designation. The address must include postal code and name of country) 

NAMAZIE . FARAH 
HAQ . MURGIANA 

OF HAQ & NAMAZIE PARTNERSHIP 
ROBINSON ROAD POST OFFICE, 
P.O. BOX 765, SINGAPORE 901515 
REPUBLIC OF SINGAPORE 



Telephone No.: 
65 438 6613 



Facsimile No.: 
65 438 7383 



Teleprinter No.: 



I | Address for correspondence: Mark this check-box where no agent or common representative is/has been 

appointed and the space above is used instead to indicate a special address to which correspondence should be sent 



Box No. IV BASIS FOR INTERNATIONAL PRELIMINARY EXAMINATION 



Statement concerning amendments:* 

1 . The applicant wishes the International Preliminary Examining Authority to start on the basis of: 
fxl the international application as originally filed 
the description 

the claims [x] as originally filed 



IXJ 


as 


□ 


as 




as 


□ 


as 


□ 


as 




as 


□ 


as 



the drawings 

2. Q The applicant wishes any amendment to the claims under Article 1 9 to be considered as reversed. 

3* CD The applicant wishes the start of the international preliminary examination to be postponed until the 
expiration of 20 months from the priority date unless the International Preliminary Examining Authority 
receive a copy of any amendments made under Article 19 or a notice from the applicant that he does not 
wish to make such amendments (Rule 69.1 (d)). This check-box may be marked only where the time iimit 
under Article 19 has not yet expired.) 

* Where no check-box is marked, international preliminary examination will start on the basis of the international application as 
originally filed or t where a copy of amendments to the claims under Article 19 and/or amendments of the international application 
under Article 34 are received by the International Preliminary Examining Authority before it has begun to draw up a written 
opinion or the international preliminary examination report, as so amended. 



Language for the purposes of international preliminary examination: ENGLISH 



|Xj which is the language in which the international application was filed. 

□ which is the language of a translation furnished for the purposes of international search. 

□ which is the language of publication of the international application. 

O which is the language of the translation (to be) furnished for the purposes of international preliminary examination. 



Box No. V ELECTION OF STATES 



The applicant hereby elects all eligible states (that is, all States which have been designated and which are bound 
by Chapter II of the PCT) 

excluding the following States which the applicant wishes not to elect: 



Form PCT/IPEA/401 (second sheet) (July 1997) 



See Notes to the demand form 



Sheet No. 3 



International application No. 
PCT/SG98/00039 



Box No. VI CHECK LIST 



The demand is accompanied by the following elements, in the language referred to in Box JMo. IV, 
for the purposes of international preliminary examination: 



translation of international application 

amendments under Article 34 

copy (or, where required, translation) of 
amendments under Article 19 

copy (or, where required, translation) of 
statement under Article 19 

letter 

other (specify) 



sheets 
sheets 

sheets 

sheets 
sheets 
sheets 



For International Preliminary 
Examining Authority use only 



received 

□ 
□ 



□ 
□ 
□ 



not received 

□ 



□ 
□ 
□ 



The demand is also accompanied by the item(s) marked below : 

1. | X | fee calculation sheet 4. | | statement explaining lack of signature 

2. | [ separate signed power of attorney 5, 

3. j X [ copy of general power of attorney; 



reference number, if any 



6. 



□ nucleotide and or amino acids listing in 
computer readable form 

| X | 0 ther (specify): Form PCT/1B/306 dated 04 November 1999 



Box No. VII SIGNATURE OF APPICANT, AGENT OR COMMON REPRESENTATIVE 



Next to each signature, indicate the name of the person signing and capacity in which the person signs (if such capacity is not 
obvious from reading the demand). 



Namazie. Farah ^ 
Agent 



For International Preliminary Examining Authority use only 



1 . Date of actual receipt of DEMAND: 



2. Adjusted date of receipt of demand due 
to CORRECTIONS under Rule 60.1(b): 



3. I I The date of receipt of the demand is AFTER the expiration of 1 9 months 
I 1 from the priority date and item 4 or 5, below, does not apply. 



The applicant has been 
informed accordingly. 



4. I I The date of receipt of the demand is WITHIN the period of 1 9 months from the priority date as extended by virtue of 
1 1 Rule 80.5. 



Although the date of receipt of the demand is after the expiration of 19 months from the priority date, the delay in 
arrival is EXCUSED pursuant to Rule 82. 



For International Bureau use only 



Demand received from IPEA on: 



Form PCT/IPEA/401 (last sheet) (July 1998) 



See Notes to the demand form 



PCT 



CHAPTER II 



International 
application No. 



FEE CALCULATION SHEET 

Annex to the Demand for international preliminary examination 

■ For International Preliminary Examination Authority use only 



PCT/SG98/00039 



Applicant's or agent's 
file reference 



SY5000149WOF 



Date stamp of the IPEA 



Applicant 



DATAMARK TECHNOLOGIES PTE LTD, et al. 



Calculation of prescribed fees 

1. Preliminary examination fee 



AUD450 



2. Handling fee (Applicants from certain States are 
entitled to a reduction of 75% of the handling fee. 
Where the applicant is (for all applicants are) so en- 
titled, the amount to be entered at H is 25% of the 
handling fee. 



AUD 224 



3. Total of prescribed fees 

Add the amounts entered at P and H 
and enter total in the TOTAL box - 



AUD 674 



TOTAL 



Mode of Payment 



□ authorization to charge deposit 
account with the IPEA (see below) 



□ cheque 

postal money order 



□ 
□ 

□ 



cash 

revenue stamps 
coupons 



bank draft 



□ others (specify): 



H 




Deposit Account Authorization (this mode of payment may not be available at all IPEAs) 

The IPEA/ O is hereby authorized to charge the total fees indicated above to my deposit account. 

| | (this check-box may be marked only if the conditions for deposit accounts of the IPEA so 
permit) is hereby authorized to charge any deficiency or credit any overpayment in the total 
fees indicated above to my deposit account. 



Deposit Account Number Date (day/month/year) Signature 

Form PCT/IPE A/401 (Annex) (July 1998) ~~ See Notes to the fee calculation sheet 



PCT/SG98/00039 

PATENT COOPERATION TREATY 



From the INTERNATIONAL BUREAU 



PCT 

NOTIFICATION OF ELECTION 

(PCT Rule 61 2) 


To: 

Assistant Commissioner for Patents 
United States Patent and Trademark 
Office 
Box PCT 

Washington, D.C.20231 
ETATS-UNIS D'AMERIQUE 

in its capacity as elected Office 


Date of mailing (day/month/year) 
21 February 2000 (21.02.00) 


International application No. 
PCT/SG98/00039 


Applicant's or agent's file reference 
SY5000149WOF 


International filing date (day/month/year) 
01 June 1998 (01.06.98) 


Priority date (day/month/year) 


Applicant 

HO, Anthony, Tung, Shuen et al __ . 



1 . The designated Office is hereby notified of its election made: 

[>C] in the demand filed with the International Preliminary Examining Authority on: 

24 December 1999 (24.12.99) 



| [ in a notice effecting later election filed with the International Bureau on: 



2. The election 

was not 



□ 



made before the expiration of 19 months from the priority date or, where Rule 32 applies, within the time limit under 
Rule 32.2(b). 





Authorized officer 


The International Bureau of WIPO 


Olivia RANAIVOJAONA 


34, chemin des Colombettes 


1211 Geneva 20, Switzerland 




Facsimile No.: (41-22) 740.14.35 


Telephone No.: (41-22) 338.83.38 


Form PCT/IB/331 (July 1992) 


3119944 



PATENT COOPERATION TRE^jD J 

PCT 

INTERNATIONAL PRELIMINARY EXAMINATION bfelRSRT 

(PCT Article 36 and Rule 70) 




Applicant's or agent's file reference 
SY5000149WOF 


FOR FURTHER See Notification of Transmittal of International Preliminary 
ACTION Examination Report (Form PCT/LPEA/4 16). 


International application No. 


International filing date (day/month/year) 


Priority Date (day/month/year) 


PCT/SG 98/00039 


1 June 1998 


1 June 1998 


International Patent Classification (IPC) or national classification and IPC 




Int. CL 7 G06F 12/14 






Applicant 

DATAMARK TECHNOLOGIES PTE LTD et al 



This international preliminary examination report has been prepared by this International Preliminary Examining 
Authority and is transmitted to the applicant according to Article 36. 

This REPORT consists of a total of 3 sheets, including this cover sheet. 

[ [ This report is also accompanied by ANNEXES, i.e., sheets of the description, claims and/or drawings which have 
been amended and are the basis for this report and/or sheets containing rectifications made before this Authority 
(see Rule 70. 16 and Section 607 of the Administrative Instructions under the PCT). 

These annexes consist of a total of sheet(s). 



3. This report contains indications relating to the following items: 



I 




II 


□ 


III 


□ 


IV 


□ 


V 




VI 


□ 


VII 


□ 


VIII 


□ 



citations and explanations supporting such statement 



Date of submission of the demand 
24 December 1999 


Date of completion of the report 
21 February 2000 


Name and mailing address of the IPEA/AU 

AUSTRALIAN PATENT OFFICE 
PO BOX 200, WODEN ACT 2606, AUSTRALIA 
E-mail address: pct@ipaustralia.gov.au 
Facsimile No. (02) 6285 3929 


Authorized Officer 

J.W. THOMSON ^ 

Telephone No. (02) 6283 2214 



Form PCT/IPEA/409 (Cover sheet) (July 1998) 



?rei£nu 



INTERNATIONAL PRED^PNARY EXAMINATION REPORT ^^International application No. 

PCT/SG 98/00039 



Basis of the report 



With regard to the elements of the international application:* 
[xl the international application as originally filed. 



UlC UCawXipUUIl, 






do UI lgJ.IUzJ.iy 111CU, 




pages 




filed with the demand, 




pages 




tiled with trie letter oi 


the claims, 


pages 




as originally filed, 




pages 


> 


as amended (together with any statement) under Article 19, 




pages 




filed with the demand, 




pages 


> 


filed with the letter of . 


the drawings, 


pages 




as originally filed, 




pages 


* 


filed with the demand, 




pages 




filed with the letter of 



| I the sequence listing part of the description: 

pages , as originally filed 
pages , filed with the demand 
pages , filed with the letter of 

2. With regard to the language, all the elements marked above were available or furnished to this Authority in the language in 
which the international application was filed, unless otherwise indicated under this item. 

These elements were available or furnished to this Authority in the following language which is: 
| [ the language of a translation furnished for the purposes of international search (under Rule 23. 1(b)). 

| [ the language of publication of the international application (under Rule 48.3(b)). 

I I the language of the translation furnished for the purposes of international preliminary examination (under Rules 55.2 
and/or 55.3). 

3. With regard to any nucleotide and/or amino acid sequence disclosed in the international application, was on the basis of 
the sequence listing: 

| | contained in the international application in written form. 

| [ filed together with the international application in computer readable form. 

| | furnished subsequently to this Authority in written form. 

[ | furnished subsequently to this Authority in computer readable form. 

| | The statement that the subsequently furnished written sequence listing does not go beyond the disclosure in the 

international application as filed has been furnished. 
| [ The statement that the information recorded in computer readable form is identical to the written sequence listing has 

been furnished 

4. The amendments have resulted in the cancellation of: 

| | the description, pages 

| [ the claims, Nos. 

[ | the drawings, sheets/fig. 

5. I I This report has been established as if (some of) the amendments had not been made, since they have been considered 

to go beyond the disclos ure as filed, as indicated in the Supplemental Box (Rule 70.2(c)).** 

* Replacement sheets which have been furnished to the receiving Office in response to an invitation under Article 14 are referred to in this 

report as "originally filed" and are not annexed to this report since they do not contain amendments (Rules 70. J 6 and 70. 1 7). 
** Any replacement sheet containing such amendments must be referred to under item 1 and annexed to this report 



Form PCT/IPEA/409 (Box I) (July 1998) 



INTERNATIONAL PREfl^pNARY EXAMINATION REPORT 



International application No. 
PCT/SG 98/00039 



V. Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 

citations and explanations supporting such statement 



1. Statement 

Novelty (N) Claims 1-64 YES 

Claims NO 

Inventive step (IS) Claims 1-64 YES 

Claims NO 

Industrial applicability (IA) Claims 1-64 YES 

Claims NO 

2. Citations and explanations (Rule 70.7) 



EP 840513 A (NIPPON ELECTRIC) 6 May 1998 

EP 855681 A (NIPPON TELEGRAPH & TELEPHONE) 29 July 1998 

EP 766468 A (NIPPON ELECTRIC) 2 April 1997 

None of these citations discloses the invention as defined in claims 1 to 64. 



Form PCT/IPEA/409 (Box V) (July 1998) 



09/701 80 9 



r ATENT COOPERATION TREA 

PCT 

INTERNATIONAL PRELIMINARY EXAMINATION REPORT 

(PCT Article 36 and Rule 70) 



Applicant's or agent's file reference 
SY5000149WOF 


FOR FURTHER See Notification of Transmittal of International Preliminary 
ACTION Examination Report (Form PCT/LPEA/4 16). 


International application No. 


International filing date (day/month/year) 


Priority Date (day/month/year) 


PCT/SG 98/00039 


1 June 1998 


1 June 1998 


International Patent Classification (LPC) or national classification and LPC 




Int CL 7 G06F 12/14 






Applicant 

DATAMARK TECHNOLOGIES PTE LTD et al 
i __ __ . 



1 . This international preliminary examination report has been prepared by this International Preliminary Examining 
Authority and is transmitted to the applicant according to Article 36. 

2. This REPORT consists of a total of 3 sheets, including this cover sheet. 

f I This report is also accompanied by ANNEXES, i.e., sheets of the description, claims and/or drawings which have 
— been amended and are the basis for this report and/or sheets containing rectifications made before this Authority 
-(see Rule 70. 16 and Section 607 of the Administrative Instructions under the PCT). 

These annexes consist of a total of sheet(s). 



3. This report contains indications relating to the following items: 
Basis of the report 



I 


m 


II . 


□ 


in 


□ 


IV 


□ 


V 


m 


VI 


□ 


VII 


□ 


VIII 


n 



Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 



Date of submission of the demand 
24 December 1999 



Date of completion of the report 
21 February 2000 



Name and mailing address of the IPEA/AU 

AUSTRALIAN PATENT OFFICE 
PO BOX 200, WODEN ACT 2606, AUSTRALIA 
E-mail address: pct@ipaustralia.gov.au 
Facsimile No. (02) 6285 3929 



Authorized Officer 

J.W. THOMSON 

Telephone No. (02) 6283 2214 



Form PCT/IPEA/409 (Cover sheet) (July 1998) 



INTERNATIONAL PRELIMfWulY EXAMINATION REPORT 



tternational application No. 
PCT/SG 98/00039 



Basis of the report 



1. With regard to the elements of the international application:* 
fx] the international application as originally filed. 

| | the description, pages , as originally filed, 

pages , filed with the demand, 

pages , filed with the letter of . 

| | the claims, pages , as originally filed, 

pages , as amended (together with any statement) under Article 19, 

pages , filed with the demand, 

pages , filed with the letter of . 

| [ the drawings, pages , as originally filed, 

pages , filed with the demand, 

pages , filed with the letter of 
| | the sequence listing part of the description: 

pages , as originally filed i 

pages , filed with the demand 

pages , filed with the letter of 

2. With regard to the language, all the elements marked above were available or furnished to this Authority in the language in 
which the international application was filed, unless otherwise indicated under this item. 

These elements were available or furnished to this Authority in the following language which is: 
| [ the language of a translation furnished for the purposes of international search (under Rule 23. 1(b)). 

| [ the language of publication of the international application (under Rule 48.3(b)). 

| | the language of the translation furnished for the purposes of international preliminary examination (under Rules 55.2 
and/or 55.3). 

3. With regard to any nucleotide and/or amino acid sequence disclosed in the international application, was on the basis of 
the sequence listing: 

| [ contained in the international application in written form. 

[ | filed together with the international application in computer readable form. 

| | furnished subsequently to this Authority in written form. 

| | furnished subsequently to this Authority in computer readable form. 

| | The statement that the subsequently furnished written sequence listing does not go beyond the disclosure in the 

international application as filed has been furnished. 
[ | The statement that the information recorded in computer readable form is identical to the written sequence listing has 

been furnished 

4. The amendments have resulted in the cancellation of: 

[ | the description, pages 
| | the claims, Nos. 
| | the drawings, sheets/fig. 
5 I - ! This report has been established as if (some of) the amendments had not been made, since they have been considered 

— to go beyon d the disclosure as filed, as indicated in the Supplemental Box (Rule 70.2(c)).** 

" Replacement sheets which have been furnished to the receiving Office in response to an invitation under Article 14 ^e^ferred to in this 

report as "originally filed" and are not annexed to this report since they do not contain amendments (Rules 70, 1 6 and 70. 1 7). 
* * Any replacement sheet containing such amendments must be referred to under i tem 1 and annexed to this report . 



Form PCT/IPEA/409 (Box I) (July 1998) 



INTERNATIONAL PRELIMINARY EXAMINATION REPORT 



International application No. 
PCT/SG 98/00039 



v 

V • 


Reasoned statement under Article 35(2) with regard to novelty, inventive step or industrial applicability; 
citations and explanations supporting such statement 


1. 


Statement 








Novelty (N) 


Claims 1-64 


YES 






Claims 


NO 




Inventive step (IS) 


Claims 1-64 


YES 






Claims 


NO 




Industrial applicability (IA) 


Claims 1-64 


YES 






Claims 


NO 



2. Citations and explanations (Rule 70.7) 



EP 840513 A (NIPPON ELECTRIC) 6 May 1998 

EP 855681 A (NIPPON TELEGRAPH & TELEPHONE) 29 July 1998 

EP 766468 A (NIPPON ELECTRIC) 2 April 1997 

None of these citations discloses the invention as defined in claims 1 to 64. 



Form PCT7IPEA/409 (Box V) (July 1998) 



INTERNATIONAL SEARCH REPORT 



international application No. 

PCT/SG 98/00039 



A. CLASSIFICATION OF SUBJECT MATTER 
IPC 6 : G 06 F 12/14 

According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 

IPC 6 : G 06 F 12/14 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 

EPODOC, WPI, PAJ 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate* of the relevant passages 



Relevant to claim No. 



EP 0 840 513 A (NIPPON ELECTRIC) 06 Msy 1998 (06.05.98), 
abstract. 

EP 0 855 681 A (NIPPON TELEGRAPH & TELEPHONE) 29 July 
1998 (29.07.98), abstract. 

EP 0 766 468 A (NIPPON ELECTRIC) 02 April 1997 (02.04.97), 
abstract. 



T** Further documents are listed in the continuation of Box C. j^j See patent family annex. 



* Special categories of cited documents: 

„A M document defining the general state of the art which is not 

considered to be of particular relevance 
„E" earlier application or patent but published on or after the international 

filing date 

„L" document which may throw doubts on priority claim(s) or which is 
cited to establish the publication date of another citation or other 
special reason ( as specified) 

„CT document referring to an oral disclosure, use, exhibition or other 
means 

J** document published prior to the international filing date but later than 
the priority dale claimed 



„T* later document published after the international filing date or priority 

date and not in conflict with the application but cited to understand 

the principle or theory underlying the invention 
„X M document of particular relevance; the claimed invention cannot be 

considered novel or cannot be considered to involve an invemive step 

when the document is taken alone 
M Y** document of particular relevance; the claimed invention cannot be 

considered to involve an inventive step when the document is 

combined with one or more other such documents, such combination 

being obvious to a person skilled in the art 
„&** document member of the same patent family 



Date of the actual completion of the international search 

11 May 1999(11.05.99) 



Date of mailing of the international search report 

21 May 1999 (21.05.99) 



Name and mailing adress of the ISA/AT 

Austrian Patent Office 
Kohlmarkt 8-10; A-1014 Vienna 

Facsimile No. 1/53424/535 



Form PCT/ISA/210 (second sheet) (July 1998) 



Authorized officer 

Fastenbauer 

Telephone No. 1/53424/447 



INTERNATIONAL SEARCH REPORT 

Information on patent family members 



International application No. 

PCT/SG 98/00039 



U tortprchenher icht 
ttoeJOhrtes Patentddkvaent 
latent document cited 
in search report JAX 
Docuwnt de brevet cite l 



Datua der 

Ver0ffentlichung 
Publication 
date 
Date de 



Mtglied(er) der 
Patentlaiille^ 
Patent tatily 
seober(s) 
Me*bre(s) de la 
iamille de brevets 



Datui der 
veroffentiichung 
Publication 

dalr 
Date de 
publication 



EP 840513 




AU 
CA 
EP 
JP 


Al 
AA 
A2 
A2 


44340/97 
2219205 
840513 
lOl 45757 


07-05-1998 

05- 05-1998 

06- 05-199B 
29-05-1998 


EP 855681 




EP 
JP 
JP 
JP 
JP 
JP 


A2 
A2 
A2 
A2 
A2 
A2 


B556B1 
1O210427 
102573-00 
1 0304323 
1101BG64 
11041573 


29-07-199B 
07-09-1998 
25-^09-1998 
13-11-1998 
22-01-1999 
12-02-1999 


EP 766468 




AU 
AU 
CA 
EP 
JP 


Al 
B2 
AA 
A2 
A2 


65B40/96 
701639 

2184949 
766468 

9191394 


10-04-1997 
04-02-1999 
29-03-1997 
02-04-1997 
22-07-1997 



c 




Form PCT/1SA/210 (patent family annex) (July 1998) 




WORLD INTELLECTUAL PROPERTY ORGANIZATION 
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(54) Title: METHODS FOR EMBEDDING IMAGE, AUDIO AND VIDEO WATERMARKS IN DIGITAL DATA 
(57) Abstract 

A method for embedding an entire image, audio or video watermark sequence 
within another image, audio or video data sequence with minimum loss of data 
quality is presented. The method exploits the de-correlation property of data 
coefficients in the orthogonal transform domain, similar to the application in 
data compression through transform coding. The present invention describes 
the usage of a Discrete Cosine Transform as the embedding domain. However, 
other orthogonal transforms such as Fourier, Walsh-Hadamard, Haar, Sine and 
Wavelet can also be used for this operation. A unique key derived adaptively from 
spatial locations registering the thresholds of the ac transform energies is used 
to unlock or de-watermark the embedded image or audio sequence. Moreover, 
an exponential filter has been developed to compress and expand the watermark 
coefficients prior to the embedding and retrieval process. The method can be used 
in resolving multimedia copyright protection issues arising on the Internet and 
in the music industry, such as the inclusion of a company's logo or an artist's 
recorded voice. The method can also be incorporated as a built-in feature for 
digital recording devices, such as still and video cameras, as well as more recent 
devices such as VCD and DVD players. Moreover, the method can be applied to 
the commercial and service sectors, where security in transmission and reception 
of private information in terms of speech or image is of the utmost importance. 
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1 

Methods for Embedding Image, Audio and Video 
Watermarks in Digital Data 
FIELD OF THE INVENTION 

This invention relates generally to the digital communications and multimedia 
5 fields and in particular the invention provides a method for the embedding and 

retrieval of digital image, audio on video watermarks in the transform domain for digital 
multimedia data, with applications in copyright protection and security data 
transmission and reception. 
BACKGROUND OF THE INVENTION 

10 The tremendous growth in multimedia products and services through the 

Internet has led to the need for copyright protection, authentication and integrity of 
data. In the past few years, a number of digital watermarking techniques have been 
developed and patents granted, for the purpose of resolving the legal use or misuse of 
copyright information on the Internet. Unlike data encryption that transforms the 

15 original data to another form for security transmission, digital watermarking embeds an 
invisible or inaudible watermark directly into the original data. 

Typical examples of recent work in the field of digital watermarking or data 
embedding are described in U.S. Patent 5636292 to Rhoads (1997) and U.S. Patent 
5659726 to Sandford and Handel (1997). Rhoads discloses methods for embedding an 

20 identification code on a carrier signal, such as an electronic data signal or a physical 

medium. Sandford and Handel disclose a method of embedding auxiliary information 
into a set of host data, such as a photograph, or a television signal. 

Prior art publications in the field of digital watermarking technology, including 
the two aforementioned granted U.S. Patents, generally envisage only the embedding 

25 of a very limited number of bits of information (in the form of binary digits * 1 ' and '0*) 
or a few characters (such as ' A12') into the carrier signal. More detailed ownership 
information requires a higher level of embedded watermark information either in the 
form of longer alphanumeric character strings or, if possible, trademarks/logo images, 
or speech of the original owner, which is embedded into and retrieved from the carrier 

30 signal. However, this has previously been considered to be very difficult to achieve, 
without significant corruption of the data being labelled as the amount of data to be 
inserted is increased. The present invention describes such a method for embedding 
digital audio or image watermarks directly into targeted audio or image data, 
substantially inaudibly or invisibly, respectively. 

35 There are many other potential consumer, commercial and service applications 

that can benefit from the use of digital watermarking technology in copyright protection 
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and security transmission. These applications include the embedding of owner 
identification, such as the trademarks or logos of an owner into digital still and video 
cameras, or copyright protection and royalty tracking monitoring of sound recordings in 
the music industry with digital audio watermarks of the artists' voice embedded into the 
5 sound tracks. 

Furthermore, commercial and service sectors are, also interested in the secure 
transmission and reception of sensitive messages, data, and even images that could be 
camouflaged into normal data streams transmitted over an open channel. 
SUMMARY OF THE INVENTION 

10 In this specification and claims the term "unlabelled data" is to be given 

the meaning of target data to which a new label is to be added by the method of the 
present invention, whether or not that target data is carrying a previously applied label. 
Similarly the term "labelled data" is to be given the meaning of target data to which 
the new label has been added by the method of the present invention. 

15 According to a first aspect, the present invention provides a method for 

applying digital watermarking image data or digital watermarking audio data to an 
unlabelled digital image, audio, or video data sample, said method including the steps 
of: 

a) inputting a set of unlabelled digital data and a set of digital watermark 

20 data; 

b) formatting the unlabelled digital data into a format suitable for 
orthogonal transformation; 

c) performing an orthogonal transformation on the formatted unlabelled 
data to produce a set of unlabelled data transform coefficients; 

25 d) formatting the digital watermark data into a format suitable for 

orthogonal transformation; 

e) performing an orthogonal transformation on the formatted watermark 
data to produce a set of watermark data transform coefficients; 

f) for each watermark data transform coefficient, allocating an 
30 unlabelled data transform coefficient to be replaced and replacing the respective 

unlabelled data transform coefficients to produce a labelled set of data transform 
coefficients; 

g) storing the locations into which watermark data transform 
coefficients were encoded in the set of labelled data transform coefficients to generate a 

35 unique key for future decoding of the watermark data; 



WO 99/63443 



PCT/SG98/00039 



3 

h) performing an inverse orthogonal transformation on the labelled data 
transform coefficients to convert them into a set of labelled digital data having a form 
resembling the original unlabelled digital data. 

Preferably, the steps of formatting the unlabelled and watermarked data 
include the steps of mapping the set of unlabelled data and the set of watermark data 
into two-dimensional matrices prior to performing the orthogonal transformations. 

Preferably also the matrices of unlabelled and watermark data are 
divided into smaller sub-blocks prior to orthogonal transformation. 

The preferred method further includes the step of ordering the 
orthogonal transformation coefficients in each sub-block of the watermark data into 
one-dimensional arrays in approximately increasing frequency order (throughout the 
specification and claims, the term "approximately increasing frequency order" is used 
in respect of one-dimensional arrays of orthogonal transform coefficients to indicate 
that the coefficients of the array are ordered in generally increasing frequency order, 
from the first to the last position in the array, with only occasional localised deviations 
from the generally increasing trend) by performing a zig-zag scan of each sub-block of 
orthogonally transformed watermark data. The reordered orthogonal transformation 
coefficients are then divided into segments for subsequent replacement into the set of 
transformation coefficients of the unlabelled data. 

The preferred method further includes the step of ordering the 
orthogonal transformation coefficients of the unlabelled data into one-dimensional 
arrays in approximately increasing frequency order by performing a zig-zag scan of 
each sub-block of orthogonally transformed unlabelled data prior to replacement of the 
watermark data coefficients and performing an inverse zig-zag scan on the labelled data 
coefficients prior to the inverse orthogonal transformation. In the step of allocating a 
segment of the orthogonally-transformed watermark data that will be encoded in each 
sub-block of the unlabelled data, the allocation may be performed in a structured or 
random manner. 

Alternatively, the zig-zag and inverse zig-zag scans of each data type can 
be replaced with a radial and inverse radial scans respectively. 

It is also preferable to calculate the mean and variance of the ac energies 
from the orthogonal transformation coefficients for each sub-block of the unlabelled 
data in order to allocate the locations of the transform coefficients of the unlabelled data 
which will be replaced by the transform coefficients of the segment of watermark data. 
Preferably the transform coefficients to be replaced in the transformed unlabelled data 
will be those in which the ac energies fall below a predetermined threshold value. 
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The transform coefficients of the watermark data embedded in the 
labelled digital data are also preferably compressed prior to embedding, using a scaling 
function. Preferably the compression function has an exponential characteristic, 
however in other embodiments scaling functions having another characteristic similar 
5 to an exponential function may be used to similar effect. 

According to a second aspect, the present invention provides a method 
for extracting digital watermarking image data or digital watermarking audio data from 
a digital image, audio, or video data sample, said method including the steps of: 

a) inputting a set of labelled digital data and unique key data containing 
10 information of locations of watermark data imposed as a label on the labelled digital 

data; 

b) mapping the set of labelled digital data into a format suitable for 
orthogonal transformation; 

c) performing an orthogonal transformation on the formatted labelled 
15 data to produce a set of labelled data transform coefficients; 

d) using the unique key to extract a segment of transform coefficients of 
orthogonally transformed watermark data from the locations in the set of labelled data 
transform coefficients specified in the key; 

e) using an inverse orthogonal transformation on the transformed 
20 watermark data to retrieve the embedded watermark data. 

Preferably, the formatting step of the watermark extraction method 
includes the step of mapping the set of labelled data into a two-dimensional matrix 
prior to performing the orthogonal transform. 

Preferably also, prior to orthogonal transformation, the matrix of labelled 
25 data is divided into the same number of smaller sub-blocks as that used in the encoding 
process. 

It is also preferable to order the orthogonal transformation coefficients of 
the labelled data in each sub-block into a one-dimensional array in approximately 
increasing frequency order by performing a zig-zag scan of each sub-block of 

30 orthogonally transformed labelled data prior to extraction of the watermark data 

coefficients and performing an inverse zig-zag scan on the extracted watermark data 
coefficients to build a matrix of sub-blocks of watermark data prior to the inverse 
orthogonal transformation. In some embodiments of the invention a radial scan is used 
in the encoding process of the unlabelled data to order the unlabelled data prior to 

35 replacement with watermark data in which case a radial scan and inverse radial scan 
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should also be used in the decoding process instead of respectively a zig-zag scan and 

inverse zig-zag scan. 

The transform coefficients of the watermark data embedded in the 

labelled digital data are also preferably compressed prior to embedding and the 
5 extraction method includes the step of expanding the compressed watermark data prior 

to the inverse orthogonal transformation, the compression and expansion steps using T . 

scaling functions each having a characteristic which is the inverse of the other. 

Preferably the compression function has an exponential characteristic and the expansion 

function has an inverse exponential characteristic. In other embodiments scaling 
10 functions having characteristics similar to an exponential and inverse exponential 

function respectively may be used to similar effect. 

In embodiments of the invention, the retrieved watermark data samples 

may either be displayed as a visual or audio output of the encoding process for 

immediate examination or authentication, or may be stored as a digital file for future 
1 5 visual or aural examination or authentication or for digital comparison with a master 

reference file. 

Preferably, the orthogonal transform is a Discrete Cosine Transform 
(DCT) and the inverse transform is an inverse DCT, however, other orthogonal 
transforms such as Fourier, Walsh-Hadamard, Haar, Sine, and Wavelet transforms can 
20 also be used. 

The unlabelled digital data samples may be obtained from a sample 
stream representing a digitised grayscale or colour image, for example, as provided by a 
digital still camera. Alternatively, the unlabelled digital data may be obtained from a 
sample stream representing digitised video in which case the source may be a video 

25 camera or a master tape of video program material. 

In the second aspect of the invention, the labelled data prior to decoding, 
will in most cases be obtained from some form of recording such as a recording on a 
Video CD (VCD), a Laser Disc (LD) or a Digital Versatile Disc (DVD) carrying a 
recording of the labelled data as the digitised video in a digitised movie or still image 

30 contained within a video game or other software. The labelled data may also be 
obtained from a broadcast transmission. 

The unlabelled and labelled digital data may also be a part of an audio 
signal in which case it may be a digitised sample stream representing digitised sound or 
music and may include two sample streams representing channel A and channel B of 

35 digitised stereo sound, each of which or either will be encoded with watermark data. 
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In the case of audio data, the transmission step might involve recording 
the labelled data on a Compact Disc (CD), Digital Audio Tape (DAT), a Laser Disc 
(LD), a Video CD (VCD), live digital broadcast, or live digital music or conversation 
down a communication channel such as a telephone line or phone through internet. 
5 The labelled digital data may also be a part of an image or a video signal that 

contains a digitised audio segment as watermark data. In this case, the transmission 
step might involve recording the labelled data on a video CD, a digital versatile disc 
(DVD), a laser disk or live transmission of images or video signals down a 
communication channel such as a telephone line or through the internet. 

10 Preferably, the watermark digital data will include one or more of: an owner's 

logo, an owner's trademark, a personal identification, an artist's recorded voice or, 
general terms for publisher distribution. 

Embodiments of the present invention provide a digital watermarking method 
that embeds and retrieves either digital audio or image watermarks in the temporal 

15 (one-dimensional) and spatial (two-dimensional) domain of digital data. Compared 

with existing methods, which target mainly the embedding of alphanumeric character 
codes as watermarks, embodiments of the present invention have the distinct advantage 
of embedding and retrieving an entire audio or image watermark into various digital 
data formats, inaudibly or invisibly, respectively. 

20 Digital watermarking methods according to the preferred embodiment of the 

invention are truly generic in the sense that they can be applied to many different 
formats of digital media. The method operates on orthogonal transform coefficients of 
the data source. The advantages of using orthogonal transforms in the field of digital 
image processing such as data compression, restoration, enhancement and pattern 

25 recognition have been well documented in the literature. The main advantage of using 
orthogonal transforms instead of a temporal or spatial domain is the de-correlation 
processes that result in fewer coefficients with significant energies of interest. 
Subsequently, a number of data processing techniques such as filtering and 
thresholding can be directly applied to the transform coefficients. 

30 Using embodiments of the present invention, a digital image of a trademark or 

logo can be embedded into and retrieved from a grayscale or colour image stored in 
either BMP, GIF, TIFF, JPEG or MPEG format. In audio watermarking, the same 
method can be used to embed a signature audio sequence into typical audio formats 
such as WAV and AIFF or into images or video signals. This method can also be 

35 extended to embedding audio watermarks in digital image or video data, such as DVD 
and VCD formats, or live signals through the internet or down a telephone line. 
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Correlation studies performed on many experimental tests of the present 
invention have revealed that the labelled (embedded or watermarked) data and the 
original unlabelled data can result in high correlation coefficient value in the range of 
approximately 0.91 to 0.99 (When there are absolutely no differences between two 
5 images, the correlation value would equal to 1.). The present method exploits the de- 
correlation property of coefficients in the transform domain for watermark embedding. 
In the transform domain, most of transform coefficient energies are associated with 
only a few low frequency coefficients thus the watermark data can be embedded in the 
high frequency region. 

10 With the tremendous growth in products and services provided through the 

Internet, the need for copyright protection, authentication and integrity of digital data is 
rapidly increasing in importance. With the present method, a company's logo or 
trademark can be embedded entirely into a digital image invisibly or into a sound track 
inaudibly. The hidden data or watermark can then be subsequently used in resolving 

1 5 copyright protection issues. 

Consumer products, such as digital still and video cameras, can also exploit the 
benefits of this invention as a built-in feature of their integrated technology, for 
example in copyright protection and product identification. Digital watermarking can 
also be very useful in commercial and personal communications. For example, 

20 classified or sensitive information can be embedded within an audio, digital still/video 
data for secure transmission and reception. 

Preferably, embodiments of the invention provide the same generic functional 
capability of a digital watermarking method whether the digital audio, or image 
watermark is embedded into any one of various data formats, such as grayscale and 

25 colour images, or audio or video data. 

According to a third aspect, the present invention provides apparatus for 
applying digital watermarking image data or digital watermarking audio data to an 
unlabelled digital image, audio, or video data sample, said apparatus including: 
a) input means arranged to input a set of unlabelled digital data; 

30 b) processing means arranged to process the unlabelled digital data to 

encode watermark data into the unlabelled data to form a set of labelled digital data; 
and 

c) output means arranged to output the labelled digital data to a 
communication or storage medium, 
35 wherein the processing means is arranged to perform the method as 

herein described. 
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According to a fourth aspect, the present invention provides an apparatus for 
extracting digital watermarking image data or digital watermarking audio data from 
labelled digital image, audio, or video data sample said apparatus including: 
a) input means arranged to input a set of labelled digital data; 
5 b) processing means arranged to process the labelled digital data to 

extract watermark data encoded into the labelled digital data; and 

c) output means arranged to output the extracted watermark digital data 
to a display or storage means, 

wherein the processing means is arranged to perform the method as herein described. 
10 According to a fifth aspect, the present invention provides a digital recording, 

recorded on any recording medium, the recording being encoded with watermark data 
in accordance with the methods described. 



BRIEF DESCRIPTION OF THE DRAWINGS 

15 Embodiments of the invention will now be described, by way of example, with 

reference to the accompanying drawings in which: 

Figure 1 illustrates a step of sub-blocking a matrix for orthogonal 
transformation used in embodiments of the invention; 

Figure 2 illustrates a zig-zag scanning technique used in an embodiment of the 
20 invention, as compared to conventional line-by-line or raster scanning; 

Figure 3 illustrates an image a) before and b) after a step of performing a 
Discrete Cosine Transform (DCT) on the sub-blocks of the image used in an 
embodiment of the invention; 

Figure 4 illustrates an exponential curve used in a step of re-scaling the 
25 transform coefficients used in embodiments of the invention; 

Figure 5 illustrates a step of embedding the watermark coefficients in a 
structured manner in accordance with an embodiment of the invention; 

Figure 6 illustrates a step of embedding the watermark coefficients in a random 
manner in accordance with another embodiment of the invention; 
30 Figure 7 illustrates a schematic block diagram of an embodiment of the present 

invention for embedding and retrieval of digital watermarks through orthogonal 
transformation; 

Figure 8 illustrates a pseudocode listing of the embodiment of figure 7 
providing a digital watermarking system that can apply to audio, image or video data. 
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Figure 9 illustrates an example of digital image watermarking of a company's 
logo, of size 128 x 128, into a real image, of size 512 x 512, of a woman's face, created 
using an embodiment of the present invention; 

Figure 10 illustrates another example of digital image watermarking of a 
5 company's logo, of size 128 x 128, into a real image, of size 5 12 x 512, of a satellite 
image, created using an embodiment of the present invention; 

Figure 1 1 illustrates a block diagram of a communications encoder/decoder for 
hidden data encoded on a communications channel; 

Figure 12 illustrates a block diagram of a multimedia encoder/decoder for 
10 watermark data; and 

Figure 13 illustrates a block diagram of a personal identification card 
encoder/decoder. 

Detailed description of embodiments of the invention 

Embodiments of a digital watermarking method will now be described in which 

15 the coefficients of a Discrete Cosine Transform (DCT) are employed. However, 

implementations of the invention are not limited solely to the use of DCT, and other 
orthogonal transforms such as discrete Fourier, Walsh-Hadamard, Haar, Sine and 
Wavelet transforms can also be used to good effect. In the preferred embodiment, both 
unlabelled data and watermark image data are first converted into two-dimensional 

20 matrices and then divided into sub-blocks, prior to orthogonal transformation. The 

present invention requires that the dimension size of the unlabelled data set must be at 
least twice the dimension size of the watermark data in each dimension, to fulfil a 
requirement that is closely related to the concept of the Shannon's sampling theorem. 
For example, fora512x512 unlabelled image, the watermark image should be 

25 typically 256 x 256 or smaller. 

Preferably each sub-block of the matrices is 8 x 8 pixels, which is typically 
considered to be a good size for data compression applications in terms of speed and 
minimum blocking edge effects, introduced by the sub-blocking process. For example, 
8x8 and 16 x 16 are commonly used in JPEG and MPEG formats, however other sub- 

30 block dimensions may also usefully be employed. After sub-blocking, the individual 
sub-block data are then mapped into the transform domain through a DCT operation. 
The respective transform coefficients are then operated on by a number of processing 
steps necessary for digital watermarking. Figure 1 illustrates the 8 x 8 sub-blocking 
blocking process in which a matrix 12 is divided into a plurality of 8x8 sub-blocks 10 

35 for orthogonal transformation. 
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Referring to Figure 2, the first processing step in the transform domain is to re- 
arrange the transform coefficients of the unlabelled and watermark data by performing 
a zig-zag scan of each sub-block. The zig-zag scanning technique has been used 
extensively in data compression. This technique essentially re-orders the transform 
5 coefficients from low frequency to high frequency in an approximately ascending 
manner. For example, for a two-dimensional sub-block of size, MxN, the dc 
transform coefficient or zero frequency component, is located at (1,1), and the other ac 
transform coefficients are at the following locations, (1,2), (1,3), (1,N), (2,1), 
(2,2), (2,3),..., (2,N), ...,(M,1), (M,2), (M,3), (M,N). The zig-zag scanning 
10 technique will re-order the coefficient locations as follows: (1,1), (1,2), (2,1), (3,1), 
(2,2), (1,3), (1,4), . . (M,N). In this manner, for each sub-block, the elements in the 
(MxN) matrix will be mapped into a one-dimensional array of size MN. Figure 2 
illustrates the zig-zag scanning technique applied to the first 8x8 sub-block 10 of Figure 
1. 

15 After zig-zag scanning, the transform coefficients are subjected to statistical 

analysis. In this operation, the ac transform energies of the unlabelled data are first 
calculated from the transform coefficients and then compared with a threshold value 
derived from the mean and standard deviation of the ac transform energies. The use of 
an adaptive energy threshold allows optimum offset positions in each one-dimensional 

20 array to be determined. The offset position in each one-dimensional array corresponds 
closely with the minimum ac energies within that array. Beyond this position, the 
transform coefficients do not play a vital role even if they are neglected. This is similar 
to conventional transform coding where data compression is achieved by coding only 
those transform coefficients with sufficient energies, which generally fall into the low 

25 frequency range. Figure 3 illustrates the DCT domain of sub-blocks of an image. 

It should be noted that the statistical method described in this embodiment is not 
the only possible method that can be used to set the location for replacement of the 
watermark data. Other adaptive filtering techniques include the choice of a fixed 
location for each watermark block, or alternatively the flexible use of statistical data 

30 such as the mean, standard deviation, and higher-order moments. 

The embedding process of watermark coefficients must avoid overwriting any 
relevant transform coefficients of the unlabelled data with significant ac energies, as 
this would introduce unnecessary errors in the unlabelled data. Locating the optimum 
locations is therefore not only important in reducing the errors but the locations also 

35 generate a unique key that will be used later for decoding. Through the process of 

embedding the unlabelled data with an invisible or inaudible watermark, the combined 
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data set will now become labelled data. Integrity of the labelled data depends entirely 
on how the ac transform coefficients of the unlabelled data are overwritten or replaced 
by the watermark transform coefficients, during the embedding process. 

The watermark data is also grouped into a two-dimensional matrix. The data is 
5 then divided into sub-blocks. Each sub-block is subjected to DCT or other orthogonal 
transformation in the same way as the unlabelled data has been treated. Again, zig-zag 
scanning is applied to arrange the transformation coefficients in an approximately 
increasing frequency order. The transformation coefficients for the watermark data are 
then blocked into segments for structured or random embedding in the transformation 

10 coefficients of the unlabelled data. Each segment of transformation coefficients to be 
embedded may be subjected to an optional scaling operation. This will help to 
minimise the overall effect of the transformation coefficients on the unlabelled data. In 
one preferred embodiment, the scaling function is an exponential function, although 
other similar mathematical functions may also be used. 

15 Figure 4 illustrates the adaptive filtering for re-scaling of transform coefficients 

that follows an exponential curve. An inverse curve to the exponential curve of Figure 
4 will be used in the decoding process. Other scaling techniques such as the reciprocal 
function, normal, log-normal, hyper-exponential, or other appropriate probability 
density functions can also be used. 

20 As the dimensional size of the unlabelled data 12 is at least twice the 

dimensional size of the watermark data 13, the embedding or encoding process of 
watermark coefficients 15 can exploit the additional sub-blocks 10 available in the 
unlabelled data 12. The encoding process can be performed either in a structured or 
random manner. For example, in a structured manner, the watermark coefficients 15 

25 can be embedded in every odd or even column or row of the unlabelled transform 

coefficient locations. While in a random manner, the watermark coefficients can be 
located in different columns or rows, depending on a specified random sequence. 
Figures 5 and 6 illustrate the watermark coefficients 15 embedded in a structured 20 
and random 22 manner, respectively. 

30 One important feature of the present invention is that the sizes of both 

unlabelled and labelled data are compatible. For example, a512x512 grayscale 
image, embedded with a 128 x 128 watermark grayscale image corresponds to exactly 
the same data size of the unlabelled image, approximately 262 kBytes. A unique key 
for the labelled image is generated and the size of the key is much less than the 

35 watermark grayscale image of size of 16.4 kBytes of data. The size of the key for a 5 12 
x 512 image is only approximately 4 kBytes. 
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The unique key and the labelled data generated will be transmitted to the 
decoder for extraction of the digital watermark. For added security, the unique key can 
be further encrypted through some random sequence. From the unique key, the spatial 
locations of the embedded watermark transform coefficients are extracted for each sub- 
5 block. The extracted transform coefficients are then expanded through the application 
of an inverse optional exponential or other appropriate compression curve. These 
expanded coefficients are subsequently converted back to follow a normal scanning 
pattern in a two-dimensional matrix before being operated on by an inverse DCT. 

Figure 7 illustrates a schematic process flow diagram of the present invention 

10 for embedding and retrieval of digital watermarks through orthogonal transformation. 

Referring to figure 7, the unlabelled raw data 12 and the watermark raw data 13 are first 
divided into sub-blocks 10, 28. Both data sub-blocks are individually transformed 
through a DCT 30. The transform coefficients of the sub-blocks are then re-ordered to 
follow a zig-zag pattern 14. Spatial locations for embedding are derived from the ac 

15 transform energies 32 of the unlabelled data 12. A unique key 34 for decoding is 

generated from these spatial locations. Prior to embedding the watermark coefficients 
onto the unlabelled spatial locations, the watermark coefficients are first compressed by 
an exponential filter 18. The compressed watermark coefficients are embedded 36 
structurally or randomly into the unlabelled sub-block DCT coefficients. The labelled 

20 coefficients are then re-ordered from a zig-zag scan pattern back to a normal scan 

pattern, before an inverse DCT transformation 38 is performed on the coefficients to 
obtain the labelled data 39. 

At the decoding end, the labelled data 38 and the unique key 34 are both read 
40. The same process of forward DCT transformation 130 and zig-zag scanning 114 

25 are also performed on the labelled data, as in the case during the embedding stage. 

From the labelled transform coefficients, the watermark coefficients are decoded 46 
from the labelled coefficients based on the spatial locations extracted 44 from the 
unique key. The watermark coefficients are expanded through an inverse exponential 
filter 48 and re-arranged to follow a normal scan pattern. This is then followed by an 

30 inverse transformation by DCT 138 to obtain the decoded watermark data. 

Figure 8a and 8b illustrate pseudocode listings of a digital watermarking coder 
and decoder system that can be applied to image, audio and video data. Figures 9 and 
10 illustrate examples of digital image watermarking in the form of a company logo of 
size 128 x 128 into two real images of size 512 x 512 of a women's face and a satellite 

35 image, respectively. Correlation analysis performed on these examples between the 
unlabelled and labelled images and original and decoded watermarks have yielded 
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correlation coefficients of 0.9932 and 0.9975 for the face and watermark, respectively. 
While for the satellite image and its logo, the correlation coefficients for unlabelled and 
labelled images and original and decoded watermarks are 0.9979 and 0.9994, 
respectively. 

5 The proposed method of digital watermarking of an audio sequence inaudibly or 

image sequence invisibly into digital data has many potentiaLapplications for resolving 
copyright protection issues in the consumer sector or for security transmission in the 
commercial and service sectors. This principle applies to personal voice 
communication through open-channel communication systems. For example, data 

10 watermarking of a company's logo/trademark or a person's identification can be 

incorporated into consumer electronic products, such as digital still/video camera and 
more recently, VCD and DVD players, to authenticate the true ownership of intellectual 
property right and consumer identification. Another major consumer area for digital 
watermarking is in the protection of illegal copying and downloading of music CDs and 

1 5 tapes. For example, the voice of the artist can be inaudibly embedded into a sound 
track through the use of the present invention. 

In the commercial sector, the copyright protection of multimedia data on the 
Internet needs also to be monitored closely, as there are tremendous amount of original 
data in the form of music, image and video, illegally downloaded and redistributed 

20 without the consent of the true owners. The present invention can be used to address 
this problem, as well as providing the security transmission of embedded data in some 
commercial banking operations. Similarly in the service sector, sensitive audio or 
image data can be embedded into an ordinary speech or image for secure transmission, 
respectively. 

25 Referring to Figure 1 1, an application of the method of the present invention is 

illustrated, in which input digital facsimile or telephone audio data 200, is encoded with 
hidden digital data 201 in a communication encoder 202 embodying an encoding 
method according to the invention. 

The encoder 202 outputs a set of labelled digital facsimile or telephone data 203 

30 and a unique key 204 as a result of the encoding process and these are transmitted via a 
communications channel 208 to a communication decoder 205 embodying a decoding 
method according to the invention. The decoder outputs labelled (i.e. unaltered) digital 
facsimile or telephone data 206 and extracted hidden data 207 which may represent a 
hidden message, or may be used to validate the source of the telephone facsimile data. 

35 Turning to the embodiment of Figure 12, a further application of the method of 

the present invention is illustrated, in which input digital audio, image or video data 
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210 is encoded with digital watermark data 21 1 in a multimedia encoder 212 
embodying an encoding method according to the invention. The encoder 212 outputs a 
set of labelled digital audio, video or image data 213 and unique key data 214 as a 
result of the encoding process and is carried as a recording on any suitable digital 
5 recording media or as a transmission over a communications or broadcast channel 218. 
In turn, the labelled data .2.13 and key data 214 are fed to a multimedia decoder 215, 
which extracts the watermark data and outputs the watermark data 217 and the labelled 
data 216. The extracted label or watermark 217 may be displayed to indicate the origin 
or ownership of the recording or transmission to the user of the data. 

10 In Figure 13, yet another application of the invention is illustrated in which 

identification information 220 such as personal identification information from an 
identification (ID) card is encoded with watermark data 221 in an identification (ID) 
card encoder 222 such that output labelled ID data 223 may be validated at a later date. 
The ID card encoder 222 outputs labelled ID data 223 and a unique key 224 produced 

15 by the encoding process for transmission 228 as part of a transaction such as a credit 
card transaction which requires secure transmission of the card holder's identity. 

A card decoder 225 which receives the transmission 228 includes a watermark 
decoder according to the present invention which inputs the transmitted labelled ID 
data 228 and the unique key 224 and outputs ID data 226 and watermark data 227. The 

20 watermark data 227 may then be used to indicate validity or otherwise of the labelled 
ID data 226 in an authentication process associated with the transaction. 

The proposed method of data watermarking can embed audio or image data, 
inaudibly or invisibly, respectively, into various digital multimedia data formats, such 
as audio, image and video. Provided the unlabelled data dimension size is at least twice 

25 the dimension size of the watermark data, an artist's recorded voice or an entire image 
of a company's logo or trademark, for example, can be embedded into audio and image 
and video data, without any serious degradation to the data quality. The proposed 
method exploits the de-correlation property of orthogonal transforms for embedding 
and retrieving digital watermarks. 

30 Although the proposed method describes mainly the use of a discrete cosine 

transform as the domain for watermarking; however, orthogonal transforms such as 
Fourier, Walsh-Hadamard, Haar, Sine and Wavelet can also be applied. Instead of the 
current watermarking technology of embedding text strings into digital data, the 
proposed method would provide additional complementary proof as to the true 

35 ownership of the digital data, by the use of a company's logo or a recording of the 
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artist's voice, making a copyright infringement claim easier to substantiate than when 
just a text string is applied as the watermark. 

The ability of the proposed method to embed and retrieve an entire audio or 
image watermark is a significant advantage over current prior art techniques that could 
5 only embed very simple and limited number of bits or characters into the data. 

Correlation performed on digital data before and after ^digital, watermarking using the 
proposed method has shown the data to be very close to one, indicating that there is 
minimum loss in data integrity. A significant advantage of the preferred embodiment is 
that the labelled and unlabelled data have the same data size. A unique key generated 

10 during the embedding process that is necessary for decoding the watermark is only 
fractional of the watermark data size. 

Digital still and video cameras can also benefit from the proposed method as a 
built-in feature of their integrated technology. Moreover, digital watermarking can be 
useful in commercial and personal communications. For example, a classified audio or 

1 5 image can be embedded into digital multimedia data for secure transmission. 

It will be appreciated by persons skilled in the art that numerous variations 
and/or modifications may be made to the invention as shown in the specific 
embodiments without departing from the spirit or scope of the invention as broadly 
described. The present embodiments are, therefore, to be considered in all respects as 

20 illustrative and not restrictive. 
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CLAIMS: 

1 . A method for applying digital watermarking image data or digital 

watermarking audio data to an unlabelled digital image, audio, or video data sample, 
said method including the steps of: 
5 a) inputting a set of unlabelled digital data and a set of digital watermark 

data; 

b) formatting the unlabelled digital data into a format suitable for 
orthogonal transformation; 

c) performing an orthogonal transformation on the formatted unlabelled 
10 data to produce a set of unlabelled data transform coefficients; 

d) formatting the digital watermark data into a format suitable for 
orthogonal transformation; 

e) performing an orthogonal transformation on the formatted watermark 
data to produce a set of watermark data transform coefficients; 

15 f) for each watermark data transform coefficient, allocating an 

unlabelled data transform coefficient to be replaced and replacing the respective 
unlabelled data transform coefficients to produce a labelled set of data transform 
coefficients; 

g) storing the locations into which watermark data transform 

20 coefficients were encoded in the set of labelled data transform coefficients to generate a 
unique key for future decoding of the watermark data; 

h) performing an inverse orthogonal transformation on the labelled data 
transform coefficients to convert them into a set of labelled digital data having a form 
resembling the original unlabelled digital data. 

25 2. The method of claim 1 wherein the step of formatting the watermark 

data includes the step of mapping the set of watermark data into a two-dimensional 
matrix. 

3. The method of claim 2 wherein the step of formatting the watermark 
data includes the step of dividing the two-dimensional matrix of watermark data into 

30 smaller sub-blocks and the step of performing the orthogonal transformation on the 

watermark data involves performing the orthogonal transform on each sub-block of the 
watermark data, such that the watermark data transform coefficients are organised in 
sub-blocks. 

4. The method as claimed in claim 3, including an ordering step in which 
35 each sub-block of the watermark data transform coefficients are reordered into a one- 
dimensional array in approximately increasing frequency order, as hereinbefore 
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defined, prior to replacement of the allotted unlabelled data transform coefficients with 
the watermark data transform coefficients. 

5. The method of claim 4, in which the step of reordering the watermark 
data transform coefficients of each sub-block is achieved by performing a zig-zag scan 

5 of the watermark data transform coefficients in the respective sub-block. 

6. The method of claim 4, in which the step of reordering the watermark 
data transform coefficients of each sub-block is achieved by performing a radial scan of 
the watermark data transform coefficients in the respective sub-block . 

7. The method as claimed in claim 4, 5 or 6, wherein after the watermark 
10 data transform coefficients of each sub-block are reordered into a one-dimensional 

array and before the replacement of unlabelled data transform coefficients with the 
watermark data the watermark data transform coefficients of each one-dimensional 
array are rescaled. 

8. The method as claimed in claim 7, wherein the rescaling is performed 

1 5 using a scaling function that reduces the magnitude of lower frequency coefficients of 
the one-dimensional array by a greater amount than higher frequency coefficients of the 
respective array. 

9. The method of claim 8, wherein the scaling function has an exponential 
characteristic. 

20 10. The method of any one of claims 4 to 9, including the step of dividing 

the reordered watermark data transform coefficients of each sub-block into segments 
for subsequent replacement into the set of transformation coefficients of the unlabelled 
data. 

25 11. The method as claimed in any one of claims 1 to 10, wherein the step of 

formatting the unlabelled data includes the step of mapping the set of unlabelled data 
into a two-dimensional matrix. 

12. The method of claim 1 1 wherein the step of formatting the unlabelled 
data includes the step of dividing the two-dimensional matrix of unlabelled data into 

30 smaller sub-blocks and the step of performing the orthogonal transformation on the 

unlabelled data involves performing the orthogonal transform on each sub-block of the 
unlabelled data, such that the unlabelled data transform coefficients are organised in 
sub-blocks. 

13. The method of claim 12, including a first ordering step in which each 
35 sub-block of the unlabelled data transform coefficients are reordered into a one- 
dimensional array in approximately increasing frequency order, as hereinbefore 
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defined, prior to replacement of allocated unlabelled data transform coefficients with 
watermark data transform coefficients, and a second ordering step in which each of the 
one-dimensional arrays of the labelled data transform coefficients are reordered into 
sub-blocks using an inverse reordering to that of the first ordering step. 
5 14. The method of claim 13, wherein the first ordering step is achieved by 

performing a zig-zag, scan of each sub-block of the unlabelled data transform ... 
coefficients and the second ordering step is achieved by performing an inverse zig-zag 
scan of each one-dimensional array of the labelled data transform coefficients. 

15. The method of claim 13, wherein first ordering step is achieved by 

10 performing a radial scan of each sub-block of the unlabelled data transform coefficients 
and the second ordering step is achieved by performing an inverse radial scan of each 
one-dimensional array of the labelled data transform coefficients. 

16. The method of claim 13, 14 or 15, including the step of, for each one- 
dimensional array of unlabelled data, determining a location beyond which the ac 

1 5 energies will fall below a certain threshold value and selecting transform coefficients 
beyond that location for replacement by transform coefficients of the watermark data. 

17. The method of claim 16, including the step of calculating the mean and 
variance values of the ac energies from the orthogonal transformation coefficients for 
each one-dimensional array of unlabelled data and calculating the threshold value as a 

20 function of the mean and variance values. 

18. The method as claimed in any one of claims 12 to 17, including the step 
of, for each one-dimensional array of the unlabelled data, allocating a segment of the 
orthogonally-transformed watermark data that will be encoded in that sub-block, if any. 

19. The method as claimed in any one of claims 1 to 1 8, wherein the 

25 orthogonal transform performed on the unlabelled data is one of: a Discrete Cosine 
Transform (DCT); a Fourier transform; a Walsh-Hadamard transform; a Haar 
transform; a sine transform; and a Wavelet transform, and the inverse transform is 
respectively; an inverse DCT; an inverse Fourier transform; an inverse Walsh- 
Hadamard transform; an inverse Haar transform; an inverse sine transform; and an 

30 inverse Wavelet transform. 

20. The method as claimed in claim 19, wherein the orthogonal transform 
performed on the unlabelled data is a Discrete Cosine Transform (DCT) and the inverse 
transform is an inverse DCT. 

21 . The method as claimed in any one of claims 1 to 20, wherein the 

35 orthogonal transform performed on the watermark data is one of: a Discrete Cosine 
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Transform (DCT); a Fourier transform; a Walsh-Hadamard transform; a Haar 
transform; a sine transform; and a Wavelet transform. 

22. The method as claimed in claim 21, wherein the orthogonal transform 

performed on the watermark data is a Discrete Cosine Transform (DCT). 
5 23. The method as claimed in any one of claims 1 to 22, including the 

further step of allocating in a structured manner a segment of the orthogonally- 
transformed unlabelled data that will be replaced by each segment of orthogonally 
transformed watermark data. 

24. The method as claimed in any one of claims 1 to 22, including the 
10 further step of allocating in a random manner a segment of the orthogonally- 
transformed unlabelled data that will be replaced by each segment of orthogonally 
transformed watermark data. 

25. The method as claimed in any one of the preceding claims wherein the 
set of unlabelled digital data is obtained from a sample stream representing a digitised 

15 grayscale or colour image. 

26. The method as claimed in claim 25, wherein the digitised grayscale or 
colour image is obtained from a digital still camera or a digital image scanner. 

27. The method as claimed in any one of claims 1 to 24, wherein the set of 
unlabelled digital data is obtained from a sample stream representing digitised video. 

20 28. The method of claim 27, wherein the unlabelled digitised video is 

obtained from a Data Storage Medium (DSM), or a real time digital data source. 

29. The method as claimed in claims 1 to 28, wherein the labelled digitised 
video is subsequently transmitted over a digital communications channel. 

30. The method as claimed in any one of claims 1 to 28, wherein the labelled 
25 digitised video is subsequently recorded on a digital recording medium. 

3 1 . The method as claimed in claim 30, wherein the digital recording 
medium is one of: a Video Compact Disc (VCD); a Laser Disc (LD); a Digital 
Versatile Disc (DVD); a digitised movie and a still image contained within a video 
game, video-on-demand or other software. 

30 32. The method as claimed in any one of claims 1 to 24, wherein the 

unlabelled digital data is obtained from a sample stream representing one or more 
channels of digitised sound or music. 

33. The method of claim 32, wherein the unlabelled digitised sound or music 

is obtained from one of: a master recording on digital audio tape played on a digital 
35 tape recorder; and a master recording on an analog audio tape played on an analog tape 
recorder and digitised via a digitising interface. 
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34. The method as claimed in any one of claims 32 to 33, wherein the 
labelled digitised sound or music is subsequently recorded on a digital recording 
medium. 

35. The method as claimed in claim 34, wherein the digital recording 

5 medium is one of: a compact Disc (CD); a Digital Audio Tape (DAT); a Laser Disc 
(LD); a Video Compact Disc (VCD). > , 

36. The method as claimed in any one of the preceding claims wherein the 
watermark digital data includes one or more of the following data items: an owner's 
logo; an owner's trademark; a personal identification; an artist's recorded voice; or 

10 general terms for publisher distribution. 

37. A method for extracting digital watermarking image data or digital 
watermarking audio data from a digital image, audio, or video data sample, said method 
including the steps of: 

a) inputting a set of labelled digital data and unique key data containing 
15 information of locations of watermark data imposed as a label on the labelled digital 

data; 

b) mapping the set of labelled digital data into a format suitable for 
orthogonal transformation; 

c) performing an orthogonal transformation on the formatted labelled 
20 data to produce a set of labelled data transform coefficients; 

d) using the unique key to extract transform coefficients of orthogonally 
transformed watermark data from the locations in the set of labelled data transform 
coefficients specified in the key; 

e) using an inverse orthogonal transformation on the transformed 
25 watermark data to retrieve the embedded watermark data. 

38. The method of claim 37 wherein the step of formatting the labelled data 
includes the step of mapping the set of labelled data into a two-dimensional matrix. 

39. The method of claim 38 wherein the step of formatting the labelled data 
includes the step of dividing the two-dimensional matrix of labelled data into smaller 

30 sub-blocks and the step of performing the orthogonal transformation on the labelled 
data involves performing the orthogonal transform on each sub-block of the labelled 
data, such that the labelled data transform coefficients are organised in sub-blocks. 

40. The method as claimed in claim 39, including the step of ordering the 
orthogonal transformation coefficients of the labelled data in each sub-block into a one- 

35 dimensional array in approximately increasing frequency order, as hereinbefore 
defined, prior to extraction of the watermark data coefficients. 
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41. The method as claimed in claim 40, wherein the ordering step is 
achieved by performing a zig-zag scan of each sub-block of orthogonally transformed 
labelled data. 

42. The method as claimed in claim 40, wherein the ordering step is 

5 achieved by performing a radial scan of each sub-block of orthogonally transformed 
labelled data. 

43. The method of any one of claims 37 to 42, wherein after extraction of 
the watermark transform coefficients from the orthogonally transformed labelled data, 
the extracted watermark data transform coefficients are arranged into a number of one- 

10 dimensional arrays corresponding to the number of sub-blocks used in the process of 
encoding the watermark data into the labelled data and each one-dimensional array is 
then reordered into a two-dimensional sub-block prior to performing the inverse 
orthogonal transform on the watermark data transform coefficients in each sub-block. 

44. The method of claim 43, wherein the reordering of each one-dimensional 
15 array of watermark data transform coefficients into a respective sub-block is achieved 

by performing an inverse zig-zag scan. 

45. The method of claim 43, wherein the reordering of each one-dimensional 
array of watermark data transform coefficients into a respective sub-block is achieved 
by performing an inverse radial scan. 

20 46. The method as claimed in any one of claims 37 to 45, wherein the 

transform coefficients of the watermark data embedded in the labelled digital data are 
compressed using a first scaling function and the method includes the step of expanding 
the compressed watermark data prior to the inverse orthogonal transformation using a 
second scaling function which is an inverse of the first scaling function. 

25 47. The method of claim 46, wherein the inverse scaling function increases 

the magnitude of lower frequency coefficients of each one-dimensional array of 
watermark data to a greater extent than it increases the magnitude of the higher 
frequency coefficients of the respective one dimensional array. 

48. The method of claim 46, wherein the first scaling function has an 

30 exponential characteristic and the second scaling function has an inverse exponential 
characteristic. 

49. The method as claimed in any one of claims 37 to 48, wherein the 
orthogonal transform performed on the labelled data is one of: a Discrete Cosine 
Transform (DCT); a Fourier transform; a Walsh-Hadamard transform; a Haar 

35 transform; a sine transform; and a Wavelet transform. 
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50. The method as claimed in claim 49, wherein the orthogonal transform 
performed on the labelled data is a DCT. 

51. The method as claimed in any one of claims 37 to 50, wherein the 
inverse orthogonal transform performed on the watermark data is one of: an inverse 

5 Discrete Cosine Transform (DCT); an inverse Fourier transform; an inverse Walsh- 
Hadamard transform; an inverse Haar transform; an inverse sine transform; and an 
inverse Wavelet transform. 

52. The method as claimed in claim 51, wherein the inverse orthogonal 
transform performed on the watermark data is an inverse DCT. 

10 53. The method as claimed in any one of claims 37 to 52, including the 

further step of displaying the watermark data samples for immediate examination or 
authentication. 

54. The method as claimed in any one of claims 37 to 52, including the 

further step of storing the watermark data samples for future examination or 
15 authentication. 

55 The method as claimed in any one of claims 37 to 54, wherein the 

labelled digital data is obtained from a sample stream representing a digitised grayscale 
or colour image. 

56. The method as claimed in claim 55, wherein the labelled digitised 
20 grayscale or colour image is obtained from a digital still camera or a digital image 

scanner. 

57. The method as claimed in any one of claims 37 to 54, wherein the 
labelled digital data is obtained from a sample stream representing digitised video. 

58. The method of claim 57, wherein the labelled digitised video is obtained 
25 from one of: a Video Compact Disc (VCD) played on a VCD player; a Laser Disc (LD) 

played on a LD player; a Digital Versatile Disc (DVD) played on a DVD player; a 
digitised movie or still image contained within a video game or other software or a 
digital signal transmitted over a communications channel. 

59. The method as claimed in any one of claims 37 to 54, wherein the 
30 labelled digital data is obtained from a sample stream representing one or more 

channels of digitised sound or music. 

60. The method of claim 59, wherein the labelled digitised sound or music is 
obtained from one of: a Compact Disc (CD) played on a CD player; a Digital Audio 
Tape (DAT) played on a DAT player; a Laser Disc (LD) played on a LD player; from a 

35 Video Compact Disc (VCD) played on a VCD player. 
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61 . The method as claimed in any one of claims 37 to 60, wherein the 
watermark digital data includes one or more of the following data items: an owner's 
logo; an owner's trademark; a personal identification; an artist's recorded voice; and 
general terms for publisher distribution. 

62. An apparatus for applying digital watermarking image data or digital 
watermarking audio data to an unlabelled digital image, audio, or video data sample, 
said apparatus including: 

a) input means arranged to input a set of unlabelled digital data; 

b) processing means arranged to process the unlabelled digital data to 
encode watermark data into the unlabelled data to form a set of labelled digital data; 
and 

c) output means arranged to output the labelled digital data to a 
communication or storage medium, 

wherein the processing means is arranged to perform the method as 
claimed in any one of claims 1 to 36. 

63. An apparatus for extracting digital watermarking image data or digital 
watermarking audio data from a labelled digital image, audio, or video data sample said 
apparatus including: 

a) input means arranged to input a set of labelled digital data; 

b) processing means arranged to process the labelled digital data to 
extract watermark data encoded into the labelled digital data; and 

c) output means arranged to output the extracted watermark digital data 
to a display or storage means, 

wherein the processing means is arranged to perform the method as claimed in any one 
of claims 37 to 61. 

64. A digital recording stored on any digital recording medium, the 
recording comprising a set of digital image, audio, or video data labelled with a 
watermark comprising a set of digital watermark image data or a set of digital 
watermark audio data, the set of labelled digital data being created by encoding a set of 
unlabelled digital data with the set of digital watermark data using the method as 
claimed in any one of claims 1 to 36. 
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•PSEUDOCODE* 

PROCEDURE WATERMARK CODER 
BEGIN 

READ UNLABELLED DATA; 

CONVERT UNLABELLED DATA TO MATRIX (M,N); 

PERFORM SUB-BLOCKING of UNLABELLED DATA; 

PERFORM DCT ON UNLABELLED DATA SUB-BLOCKS; 

RE-ORDER DCT COEFFICIENTS TO FOLLOW ZIG-ZAG PATTERN; 

DETERMINE AC ENERGIES OF DCT COEFFICIENTS; 

SET THRESHOLD BASED ON AC ENERGY MEAN AND STANDARD 

DEVIATION; 

COMPARE SUB-BLOCK AC ENERGIES WITH THRESHOLD; 
IF AC ENERGIES LESS THAN THRESHOLD THEN 
STORE SPATIAL LOCATIONS; 

ELSE 

SET TO OFFSET SPATIAL LOCATIONS; 

END 

GENERATE UNIQUE KEY FROM STRUCTURED/RANDOM SPATIAL 
LOCATIONS; 

STORE UNIQUE KEY FOR DECODING; 
READ WATERMARK DATA; 

CONVERT WATERMARK DATA TO MATRIX (J,K); 
PERFORM SUB-BLOCKING of WATERMARK DATA; 
PERFORM DCT ON UNLABELLED DATA SUB-BLOCKS; 
RE-ORDER DCT COEFFICIENTS TO FOLLOW ZIG-ZAG PATTERN; 
RE-SCALE DCT COEFFICIENTS USING EXPONENTIAL FILTER; 

EMBED RE-SCALED WATERMARK DCT COEFFICIENTS INTO 
UNLABELLED DCT SUB-BLOCKS; 
CONVERT ZIG-ZAG SCAN BACK TO NORMAL SCAN; 
INVERSE DCT SUB-BLOCKS TO OBTAIN LABELED DATA; 

END 
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♦PSEUDOCODE* 

PROCEDURE WATERMARK DECODER 

BEGIN 

READ LABELED DATA; 

CONVERT LABELED DATA TO MATRIX (M,N); 

PERFORM SUB-BLOCKING of LABELED DATA; 

PERFORM DCT ON LABELED DATA SUB-BLOCKS; 

RE-ORDER DCT COEFFICIENTS TO FOLLOW ZIG-ZAG PATTERN; 

EXTRACT SPATIAL LOCATIONS FROM UNIQUE KEY; 
DECODE WATERMARK DCT COEFFICIENTS FROM SPATIAL 
LOCATIONS; 

SCALE WATERMARK DCT COEFFICIENTS USING INVERSE 
EXPONENTIAL FILTER; 

CONVERT ZIG-ZAG SCAN BACK TO NORMAL SCAN; 
INVERSE DCT SUB-BLOCKS TO OBTAIN WATERMARK DATA; 



END 



FIGURE 8b 



SUBSTITUTE SHEET (RULE 26) 



WO 99/63443 



8/10 



PCT/SG98/00039 




FIGURE 9 
SUBSTITUTE SHEET (RULE 26) 




(a) (b ) 



FIGURE 10 

SUBSTITUTE SHEET (RULE 26)' 



WO 99/63443 



4 



PCT/SG98/00039 



10/ 10 



Telephone/ 
Fax data 



20o/ 
201 



0-+ 



\ 



0+ 



Hidden 
Data 



COMMS 
Encoder 

202 



Labelled 
dataQ 



\ 



■CF 



203 
208" 
204 



Unique key 



COMMS 
Decoder 

205 



Labelled 
Phone/Fax 



r, data 



V 



-0* 



206 
07 



Hidden 
data 



FIGURE 11 



Audio, Image, 
Video data 



210/ 
211 



0-* 



0* 



Watermark 
Data 



Labelled 





data^ 


Multimedia 




Encoder 




212 


— ( 



213 
218" 
'214 



Unique key 



V— ► 






Multimedia 




Decoder 


1— > 


215 





-Q 



Labelled 
Audio, Image, 
data 



216 
.217 



Watermark 
data 



FIGURE 12 



User ID 
data 




User ID 

Card 
Encoder 

222 



Hidden 
Data 



Labelled 
User ID 
data^ 



■0 



223 
228' 
'224 



Unique key 





User ID 




Card 




Decoder 


— ► 


225 



Labelled 
User ID 
r. data 

-0 ► 



226 



-02 



27 



Watermark 
data 



FIGURE 13 



SUBSTITUTE SHEET (RULE 26) 



4 



INTERNATIONAL SEARCH REPORT 



International application No. 

PCT/SG 98/00039 



A. CLASSIFICATION OF SUBJECT MATTER 
IPC 6 : G 06 F 12/14 

According to International Patent Classification (IPC) or to both national classification and IPC 



B. FIELDS SEARCHED 



Minimum documentation searched (classification system followed by classification symbols) 

IPC 6 : G 06 F 12/14 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 



Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 

EPODOC, WPI, PAJ 



C . DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 



Citation of document, with indication, where appropriate, of the relevant passages 



Relevant to claim No. 



EP 0 840 513 A (NIPPON ELECTRIC) 06 Msy 1998 (06.05.98), 
abstract. 

EP 0 855 681 A (NIPPON TELEGRAPH & TELEPHONE) 29 July 
1998 (29.07.98), abstract. 

EP 0 766 468 A (NIPPON ELECTRIC) 02 April 1997 (02.04.97), 
abstract. 



□ 



Further documents are listed in the continuation of Box C. 



See patent family annex. 



* Special categories of cited documents: 

„A" document defining the general state of the art which is not 

considered to be of particular relevance 
„E" earlier application or patent but published on or after the international 

filing date 

„L" document which may throw doubts on priority claim(s) or which is 
cited to establish the publication date of another citation or other 
special reason (as specified) 

„0" document referring to an oral disclosure, use, exhibition or otlier 
means 

„P" document published prior to the international filing date but later than 
the priority date claimed 



„T* later document published after the international filing date or priority 

date and not in conflict with the application but cited to understand 

the principle or theory underlying the invention 
„X** document of particular relevance; the claimed invention cannot be 

considered novel or cannot be considered to involve an inventive step 

when the document is taken alone 
„Y" document of particular relevance; the claimed invention cannot be 

considered to involve an inventive step when the document is 

combined with one or more other such documents, such combination 

being obvious to a person skilled in the art 
„&" document member of the same patent family 



Date of the actual completion of the international search 

11 May 1999(11.05.99) 



Date of mailing of the international search report 

21 May 1999 (21.05.99) 



Name and mailing adress of the ISA/AT 

Austrian Patent Office 
Kohlmarkt 8-10; A-1014 Vienna 
Facsimile No. 1/53424/535 



Authorized officer 

Fastenbauer 

Telephone No. 1/53424/447 



Form PCT/ISA/210 (second sheet) (July 1998) 



i 



INTERNATIONAL SEARCH REPORT 

Information on patent family members 



International application No. 

PCT/SG 98/00039 



l« Recherchenbericht 
angeffihrtes Patentdokuaent 
Patent document cited 
in search report 
Document de brevet cite 
dans le rapport de recherche 



Datum der 
Verdf lent lichung 
Publication 
date 
Date de 
publication 



Mtqlied(er) der 
Paten tfaai lie 
Patent fa»ily 
seoberfs) 
Heebre(s) de la 
faaille de brevets 



Datum der 
Weroffentlichung 
Publication 

dale 
Date de 
publication 



EP 



84051-' 



AU Al 

CA A A 

EP A2 

JP A2 



44340/ 97 
2219205 
840513 
lOl 45757 



07-O5- 

05- 05- 

06- C5- 
29-05- 



1998 
1998 
199B 
199B 



EP 



855681 



EP A2 

JP A2 

JP A2 

JP A2 

JP A2 

JP A2 



1 

102573*00 
1 0304323 
1 1018064 
1 1041573 



29-G7- 
07-08- 

25-G9- 
13-1 1- 

22-01- 
12-02- 



199B 
1998 
■1998 
-1998 
•1999 
-1999 



EP 



766468 



AU Al 

AU B2 

CA AA 

EP A2 

JP A2 



65840/96 
701639 

21B4949 
766468 

9191 394 



1 0-C4- 
04-02- 
29-C3- 
02-04- 
22-07- 



1997 
1999 
1997 
1°97 
1997 



Form PCT/ISA/2I0 (patent family annex) (July 1998) 



